New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Consider getting rid of zookeeper as a coordinator #281

Open

michal-harish opened this issue Oct 16, 2019 · 1 comment

Labels

Member

michal-harish commented Oct 16, 2019 •

edited

Loading

The purpose of the coordinator is to allow nodes to come online and offline dynamically. This is achieved by the following 3 functions:

inform about nodes coming online/offline and mediate their addresses to each other
generate assignment for each keyspace based on required replication factor and a state of previous assignment (to move as few partitions as possible)
elect leaders for online replicas of the same partition

michal-harish added the enhancement label

Member Author

michal-harish commented Oct 26, 2019

this could be done by a combination of gossip/raft and single-partition kafka topic

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment