Skip to content

Commit

Permalink
feat: add test for updating leaderboard
Browse files Browse the repository at this point in the history
  • Loading branch information
YannDubs committed Oct 24, 2023
1 parent 0137777 commit afdef27
Showing 1 changed file with 33 additions and 0 deletions.
33 changes: 33 additions & 0 deletions .github/workflows/test_update_leaderboard.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,33 @@
name: test format leaderboard

on:
pull_request:
branches:
- main
paths:
- 'src/alpaca_eval/leaderboards/data_AlpacaEval/**'
- 'results/**'
workflow_dispatch:

jobs:
format_leaderboard:
runs-on: "ubuntu-20.04"

steps:
- name: Checkout code
uses: actions/checkout@v3

- name: Set up Python
uses: actions/setup-python@v4
with:
python-version: '3.10'
cache: "pip"

- name: Install dependencies
run: pip install .

- name: Format sample sheets
run: python docs/format_sample_sheets.py

- name: Update leaderboard
run: python docs/format_export_leaderboards.py

0 comments on commit afdef27

Please sign in to comment.