You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Related to #27, we should run ibctest against that large matrix on a schedule. We don't want the large matrix to gate ibctest CI, because some tests will likely fail on a large enough set of chains.
This might run on GitHub Actions or it might run somewhere else. We should also consider where this will archive the test report output.
The text was updated successfully, but these errors were encountered:
One thought here, we don't need to re-run for existing tags, assuming chains don't delete and re-create tags. It would be nice if the suite could use the latest tag in the matrix file for the chain sets, so we are always testing the latest version of the chain on the scheduled runs. But then we could build caching that would only run the conformance tests for a chain set if the checksum changed for the latest tag of the docker image for either of the involved chains.
jonathanpberger
changed the title
Run large test matrix on a schedule
Large test matrix should be runnable on a schedule.
Mar 20, 2023
Related to #27, we should run ibctest against that large matrix on a schedule. We don't want the large matrix to gate ibctest CI, because some tests will likely fail on a large enough set of chains.
This might run on GitHub Actions or it might run somewhere else. We should also consider where this will archive the test report output.
The text was updated successfully, but these errors were encountered: