Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pipelined/concurrent read for startup #5

Open
dgrnbrg opened this issue Dec 23, 2013 · 0 comments
Open

Pipelined/concurrent read for startup #5

dgrnbrg opened this issue Dec 23, 2013 · 0 comments

Comments

@dgrnbrg
Copy link
Contributor

dgrnbrg commented Dec 23, 2013

This improves application startup by allowing for parallel startup. Currently, we interleave reading hints/entries from the files on application startup with processing them into keydir entries and loading them into the keydir. These could be done on 2 threads: one for IO, and one for parsing. Also, the files are read sequentially, when really they could be read concurrently to further improve startup time.

If they are read concurrently, we'd need to choose the latest value for the keydir based on the file's timestamp, since the unix timestamps stored in the file are of insufficient resolution.

@dgrnbrg dgrnbrg modified the milestones: v4, v3 Feb 3, 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant