Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

draw inspiration from Netflix DBLog's lock-free algorithm to improve #4

Open
hantmac opened this issue Jul 24, 2023 · 3 comments
Open

Comments

@hantmac
Copy link
Collaborator

hantmac commented Jul 24, 2023

Problems and Points for improvement

  • Due to the integration of Debezium Engine, full-load reading phase does not support checkpoint. After a failure, it needs to be re-read.
  • Currently, only single concurrency is supported, and horizontal scaling is not supported.
  • When ensuring data consistency, Debezium needs to apply locks to the read databases or tables. Global locks may cause the database to hang, while table-level locks can restrict table reads.
@hantmac
Copy link
Collaborator Author

hantmac commented Jul 24, 2023

@codering
Copy link

How is it going now ?

@hantmac
Copy link
Collaborator Author

hantmac commented Aug 18, 2023

@codering Not started yet 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants