Skip to content

Commit

Permalink
add timing to README
Browse files Browse the repository at this point in the history
  • Loading branch information
sammsaski committed Dec 7, 2024
1 parent 3a8151f commit f656198
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions code/nnv/examples/Submission/FORMALISE2025/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -64,7 +64,7 @@ pip install -e .

5. With all of these steps done, you are now ready to begin reproducing the artifacts.

# Smoke Test Instructions
# Smoke Test Instructions (~1min)

Instructions to quickly test the software needed to reproduce the artifacts of the paper. If no issues arise during the smoke test, you can safely proceed to reproducing all artifacts as described in the below sections.

Expand All @@ -84,7 +84,7 @@ chmod +x run_smoketest.sh && ./run_smoketest.sh
**********************************************
```

# Reproducing a Subset of the Results
# Reproducing a Subset of the Results (~1-2 hours)

Assuming the average runtime for the experiments remains as shown in the paper, then it will take approximately 9-10 days to reproduce the results. For that reason, this set of instructions is for reproducing a subset of the results. More specifically, we reproduce the first row of Table 2 from the paper, e.g. the verification results for the 4-frame variation of the Zoom In dataset with the relax verification algorithm. The results will be output to the console after the script completes. Additionally, this script will generate the reachable output range plots used in Figure 7.

Expand Down

0 comments on commit f656198

Please sign in to comment.