Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rework lock sharing between Selector instances #309

Open
MaxiBoether opened this issue Oct 10, 2023 · 0 comments
Open

Rework lock sharing between Selector instances #309

MaxiBoether opened this issue Oct 10, 2023 · 0 comments
Labels

Comments

@MaxiBoether
Copy link
Contributor

Right now, we pre-allocate 64 locks and assign each pipeline a lock based on their ID. This is (just as in #308), because sub-processes (the gRPC server instances) cannot allocate new locks on demand from a manager. This would need access to the manager in the subprocess. We would like to have 1 lock per Selector instance instead of a fixed pre-allocated amount of locks.

This might require some rework of how we do multiprocessing in the Selector, which can be done in conjunction with #308.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant