-
Notifications
You must be signed in to change notification settings - Fork 2
Pre release Checklist
Chih-Hao Wang edited this page Oct 21, 2022
·
5 revisions
We should check at least the following things before making a release:
- If openapi.yaml is changed, remember to update its version and the
explainaboard_api_client
dependency in CLI - The dataset page displays and can be scrolled through
- The system page displays and can be scrolled through
- Both pages above can also be viewed when not logged in (in an incognito window)
- It is possible to submit the SST2 example, analysis works, and error cases are displayed (tests text classification): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/sst2
- It is possible to submit the ConLL example, analysis works, and error cases are displayed (tests sequence labeling): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/conll2003
- It is possible to submit the CoNaLa example, analysis works, and error cases are displayed (tests seq2seq): https://github.com/neulab/ExplainaBoard/tree/main/data/system_outputs/conala
- Able to edit all editable fields of a system
- Able to delete a system
- Able to view systems in which you are a shared user
- If there is a DB migration, add a record to this issue, which keeps track of all DB migration histories.