WIP controller <-> scheduler coordination on server status updates #5886
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
lc525
force-pushed
the
shared/server-status-updates
branch
from
29f3945 to
998bb9a
Compare
|
This PR will not be merged. It is used just to share in-progress code, and will be closed when the equivalent functionality has been implemented through other PRs. |
sakoush
added a commit
to sakoush/seldon-core
that referenced
this pull request
Sep 17, 2024
sakoush
added a commit
that referenced
this pull request
Sep 24, 2024
* Start envoy xDS server last * Orginise starter cmd for scheduler * Add synchroniser interface and simple timerbased impl * Separate out logic when agent connects * Integrate simple synchroniser in code * Add first sync option to ServerNotify * Adjust controller to set isFirstSync * Allow servernotify initial sync to start the sync process in scheduler * Rename start to signal in synchroniser * fFx test * Add test for ServerNotify * Change interface to allow for number of signals to wait for * Changes from #5886 (to include server events) * Add testing for servers (and other events) in hub * Add test for AddServerReplica * Add server sync impl * Add test for server sync * Add more testing coverage * Add logging * Wireup server changes in starter cmd * Add extra logging * Skip logging if not required * Start timer from the begining. * Tidy up logic and add more tests * Wire up simple sync for the non k8s case * Use waut group instead of a channel for sync * Tidy up log messages * Lint fixes * Set default timeout for scheduler readiness in docker-compose setup * Add explicit envar for scheduler ready timeout (compose) * Fix lint * Fix test * Add architecture design at the start of the file for server sync * Add new line * Tidy up name in test * Add parametrisation for helm for SCHEDULER_READY_TIMEOUT_SECONDS * Add log message for variable * Add note why xDS starts last * Add extra wait for routes to be established. * Tidy up event hub code * Tidy up event handling code
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Work in progress for better state sharing between controller and scheduler,
taking into account possible failures on both ends.