You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Nov 24, 2021. It is now read-only.
As a form of regression testing, we should be keeping track of how simulation results change over time. As we update the model and make changes to the connector code, we should be able to see how each change affects the output.
To start with, we can look at the Imperial model. See #40 for how we can generate the comparisons. This issue is about automating the process for one or more sets of runs and doing this comparison daily.
For each of these runs, choose a region, a set of interventions and a calibration date (along with the death count). Perform the run in a github action. After the run completes, perform a comparison with the previous day's run. Store the results as an artifact. And if the results indicate a large enough difference, fail the run.
The text was updated successfully, but these errors were encountered:
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
As a form of regression testing, we should be keeping track of how simulation results change over time. As we update the model and make changes to the connector code, we should be able to see how each change affects the output.
To start with, we can look at the Imperial model. See #40 for how we can generate the comparisons. This issue is about automating the process for one or more sets of runs and doing this comparison daily.
For each of these runs, choose a region, a set of interventions and a calibration date (along with the death count). Perform the run in a github action. After the run completes, perform a comparison with the previous day's run. Store the results as an artifact. And if the results indicate a large enough difference, fail the run.
The text was updated successfully, but these errors were encountered: