Skip to content

Harness/run mistral #34

Harness/run mistral

Harness/run mistral #34

Triggered via pull request November 11, 2023 03:15
Status Cancelled
Total duration 10h 52m 48s
Artifacts 8

llm-harness-evaluation.yml

on: pull_request
llm-cpp-build  /  check-linux-amx-artifact
3s
llm-cpp-build / check-linux-amx-artifact
llm-cpp-build  /  check-linux-avx512-artifact
3s
llm-cpp-build / check-linux-avx512-artifact
llm-cpp-build  /  check-linux-avxvnni-artifact
2s
llm-cpp-build / check-linux-avxvnni-artifact
llm-cpp-build  /  check-windows-avx-artifact
1s
llm-cpp-build / check-windows-avx-artifact
llm-cpp-build  /  check-windows-avx-vnni-artifact
2s
llm-cpp-build / check-windows-avx-vnni-artifact
llm-cpp-build  /  check-windows-avx2-artifact
3s
llm-cpp-build / check-windows-avx2-artifact
llm-cpp-build  /  linux-build-amx
1m 45s
llm-cpp-build / linux-build-amx
llm-cpp-build  /  linux-build-avx512
1m 44s
llm-cpp-build / linux-build-avx512
llm-cpp-build  /  linux-build-avxvnni
1m 43s
llm-cpp-build / linux-build-avxvnni
llm-cpp-build  /  windows-build-avx
50s
llm-cpp-build / windows-build-avx
llm-cpp-build  /  windows-build-avx-vnni
3m 38s
llm-cpp-build / windows-build-avx-vnni
llm-cpp-build  /  windows-build-avx2
1m 1s
llm-cpp-build / windows-build-avx2
Matrix: llm-harness-evalution
Fit to window
Zoom out
Zoom in

Annotations

8 errors
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, sym_int4)
The operation was canceled.
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, fp4)
The operation was canceled.
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, mixed_4bit)
The operation was canceled.
llm-harness-evalution (3.9, Mistral-7B-v0.1, truthfulqa, fp8)
The operation was canceled.

Artifacts

Produced during runtime
Name Size
linux-amx Expired
4.94 MB
linux-avx Expired
1.77 MB
linux-avx2 Expired
1.71 MB
linux-avx512 Expired
3.31 MB
linux-avxvnni Expired
10.8 MB
windows-avx Expired
1.72 MB
windows-avx-vnni Expired
5.15 MB
windows-avx2 Expired
2.6 MB