Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🚀[FEA]: Making scoring resumable #95

Open
nbren12 opened this issue Nov 1, 2023 · 0 comments
Open

🚀[FEA]: Making scoring resumable #95

nbren12 opened this issue Nov 1, 2023 · 0 comments
Assignees
Labels
0 - Backlog In queue waiting for assignment enhancement New feature or request

Comments

@nbren12
Copy link
Collaborator

nbren12 commented Nov 1, 2023

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Critical (currently preventing usage)

Please provide a clear description of problem you would like to solve.

Scoring large models is an expensive workload, and sometimes cannot be completed in a single session. It would be nice to make both lagged ensembles and medium range resumable.

Alternatively could add a --n-shard --shard flags to the medium range inference scripts to make the problem size small enough to complete in one session.

This is blocking graphcast scoring.

Describe any alternatives you have considered

No response

@nbren12 nbren12 added enhancement New feature or request ? - Needs Triage Need team to review and classify labels Nov 1, 2023
@nbren12 nbren12 self-assigned this Nov 4, 2023
@NickGeneva NickGeneva added 0 - Backlog In queue waiting for assignment and removed ? - Needs Triage Need team to review and classify labels Nov 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0 - Backlog In queue waiting for assignment enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants