New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support continuation / resume of runs #141

Open

leondz opened this issue Jun 19, 2023 · 1 comment

Labels

architecture reporting

Milestone

25.02 Efficiency

Collaborator

leondz commented Jun 19, 2023 •

edited

Loading

It should be possible to continue an incomplete run, given the partial report.jsonl.

This may involve:

reading & loading the config from the report.jsonl
working out which attempts are complete and which need to be processed still (based on attempt status)
re-creating the complete and, maybe? incomplete attempts
setting up a run using the remaining, non-executed probes
writing a new report.jsonl including what's known so far
running those not-yet-executed probes

The interface might look like:

--continue switch: take json from report, process attempts, continue from where we stopped. requires robust config storage

The text was updated successfully, but these errors were encountered:

leondz added the architecture label

This was referenced Jun 19, 2023

add ability to reevaluate runs #142

Open

add option to re-produce a prior run #143

Open

leondz added the reporting label

leondz added this to the 25.02 Efficiency milestone

Collaborator Author

leondz commented Jan 11, 2025

issue #833 contributed to this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment