LLM Harness Evalution

LLAMA 7b leaderboard run #5

Sign in to view logs

Re-run triggered November 8, 2023 13:33

hkvision

#9388

zhentaocc:llb-llama7b

Status Cancelled

Total duration 6m 3s

Artifacts 8

llm-harness-evaluation.yml

on: pull_request

llm-cpp-build / check-linux-amx-artifact

llm-cpp-build / check-linux-avx512-artifact

llm-cpp-build / check-linux-avxvnni-artifact

llm-cpp-build / check-windows-avx-artifact

llm-cpp-build / check-windows-avx-vnni-artifact

llm-cpp-build / check-windows-avx2-artifact

llm-cpp-build / linux-build-amx

llm-cpp-build / linux-build-avx512

llm-cpp-build / linux-build-avxvnni

llm-cpp-build / windows-build-avx

llm-cpp-build / windows-build-avx-vnni

llm-cpp-build / windows-build-avx2

Matrix: llm-nightly-harness-test

Annotations

4 errors

llm-nightly-harness-test (3.9, Llama-2-7b-chat-hf, hellaswag, int4)

Canceling since a higher priority waiting request for 'LLM Harness Evalution-llm-nightly-test-9388' exists

llm-nightly-harness-test (3.9, Llama-2-7b-chat-hf, hellaswag, int4)

The operation was canceled.

llm-nightly-harness-test (3.9, Llama-2-7b-chat-hf, mmlu, int4)

Canceling since a higher priority waiting request for 'LLM Harness Evalution-llm-nightly-test-9388' exists

llm-nightly-harness-test (3.9, Llama-2-7b-chat-hf, mmlu, int4)

The operation was canceled.

Artifacts

Produced during runtime

Name	Size
linux-amx Expired	4.93 MB
linux-avx Expired	1.77 MB
linux-avx2 Expired	1.71 MB
linux-avx512 Expired	3.31 MB
linux-avxvnni Expired	10.8 MB
windows-avx Expired	1.72 MB
windows-avx-vnni Expired	5.14 MB
windows-avx2 Expired	2.59 MB