Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor harvesters into microservices #70

Open
tmaiaroto opened this issue Jun 17, 2015 · 0 comments
Open

Refactor harvesters into microservices #70

tmaiaroto opened this issue Jun 17, 2015 · 0 comments

Comments

@tmaiaroto
Copy link
Member

Use https://github.com/koding/kite to take each harvester and put them into their own microservice. They may all end up running on the same server (different ports) and that's ok. The repo can even be restructured so that everything runs as a single binary without the microservices running on different ports... But the ability to separate each harvester on to a separate server is going to be one of the core focuses for version 2.0.

It's a matter of scale. Most users likely won't need this, but for SocialHarvest to truly be a flexible and modular platform, this is critical. There will be a message bus or data flow that allows people to add in new services that harvest different data into the system.

This may, of course, break database schema (and new storage solutions may be required) - which is why this won't be considered until version 2.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant