Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Performance improvements for Task throughput #446

Open
shawn-hurley opened this issue Oct 23, 2024 · 0 comments
Open

[Feature] Performance improvements for Task throughput #446

shawn-hurley opened this issue Oct 23, 2024 · 0 comments
Assignees
Labels
agent enhancement New feature or request server
Milestone

Comments

@shawn-hurley
Copy link
Contributor

We need to re-architecture the RCM/Agents/TaskRunner to make performance improvements possible:

  1. Agents should NEVER update the filesystem directly, the changes should be done in the task runner.
  2. The TaskRunner, should call the RCM on "Commit" in such a way that the files are then updated on disk.
  3. The RCM locks on commit, and will not unlock until validators have been completed.
  4. We want some way, on commit, that if the task has been fixed, the commit is thrown away.

This would allow us to then move the task and task runner to be async and for the task manager to run tasks in parallel.

@shawn-hurley shawn-hurley added agent enhancement New feature or request server labels Oct 23, 2024
@shawn-hurley shawn-hurley added this to the Milestone #3 milestone Oct 23, 2024
@jwmatthews jwmatthews changed the title [Feature] Performance imporvements for Task throughput [Feature] Performance improvements for Task throughput Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
agent enhancement New feature or request server
Projects
Status: No status
Development

No branches or pull requests

2 participants