Skip to content

Commit

Permalink
remove limit in harness run (#10139)
Browse files Browse the repository at this point in the history
  • Loading branch information
pengyb2001 authored Feb 9, 2024
1 parent 474d952 commit 791dad0
Showing 1 changed file with 1 addition and 3 deletions.
4 changes: 1 addition & 3 deletions .github/workflows/llm-harness-evaluation.yml
Original file line number Diff line number Diff line change
Expand Up @@ -169,7 +169,6 @@ jobs:
env:
USE_XETLA: OFF
# SYCL_PI_LEVEL_ZERO_USE_IMMEDIATE_COMMANDLISTS: 1
# TODO: limit just for debug, remove it later
run: |
export HF_HOME=${HARNESS_HF_HOME}
export HF_DATASETS=$HARNESS_HF_HOME/datasets
Expand All @@ -183,8 +182,6 @@ jobs:
--device ${{ matrix.device }} \
--tasks ${{ matrix.task }} \
--batch_size 1 --no_cache --output_path results \
--limit 3
- uses: actions/upload-artifact@v3
with:
Expand Down Expand Up @@ -225,6 +222,7 @@ jobs:
ls results
python ${{ github.workspace }}/python/llm/dev/benchmark/harness/make_table_and_csv.py results
# TODO: change machine to store the results later
llm-harness-summary-nightly:
if: ${{github.event_name == 'schedule' || github.event_name == 'pull_request'}}
needs: [set-matrix, llm-harness-evalution]
Expand Down

0 comments on commit 791dad0

Please sign in to comment.