Skip to content
LLM Harness Evaluation

LLM Harness Evaluation #516

Sign in to view logs

LLM Harness Evaluation

LLM Harness Evaluation #516

Run time

Learn about OS pricing on GitHub Actions
Job Run time
set-matrix
1s
llm-cpp-build / check-linux-amx-artifact
2s
llm-cpp-build / check-linux-avx512-artifact
2s
llm-cpp-build / check-linux-avxvnni-artifact
2s
llm-cpp-build / check-windows-avx2-artifact
0s
llm-cpp-build / check-windows-avx-artifact
0s
llm-cpp-build / check-windows-avx-vnni-artifact
0s
llm-cpp-build / windows-build-avx2
0s
llm-cpp-build / windows-build-avx
0s
llm-cpp-build / windows-build-avx-vnni
0s
llm-cpp-build / linux-build-avx512
2m 36s
llm-cpp-build / linux-build-avxvnni
1m 15s
llm-cpp-build / linux-build-amx
1m 0s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)
48m 21s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)
50m 13s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)
21m 34s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)
22m 41s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)
11m 11s
llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)
10m 46s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)
40m 26s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, arc, fp8, xpu)
42m 17s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)
20m 0s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)
23m 5s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)
10m 47s
llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)
11m 9s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, arc, sym_int4, xpu)
49m 1s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, arc, fp8, xpu)
50m 11s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)
23m 47s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, truthfulqa, fp8, xpu)
24m 19s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, winogrande, sym_int4, xpu)
11m 13s
llm-harness-evaluation (3.11, Mistral-7B-v0.1, winogrande, fp8, xpu)
12m 50s
llm-harness-evaluation (3.11, mpt-7b-chat, arc, sym_int4, xpu)
49m 53s
llm-harness-evaluation (3.11, mpt-7b-chat, arc, fp8, xpu)
51m 14s
llm-harness-evaluation (3.11, mpt-7b-chat, truthfulqa, sym_int4, xpu)
20m 36s
llm-harness-evaluation (3.11, mpt-7b-chat, truthfulqa, fp8, xpu)
22m 31s
llm-harness-evaluation (3.11, mpt-7b-chat, winogrande, sym_int4, xpu)
10m 48s
llm-harness-evaluation (3.11, mpt-7b-chat, winogrande, fp8, xpu)
11m 22s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)
49m 37s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)
52m 28s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)
23m 59s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)
26m 31s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)
11m 29s
llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)
12m 36s
llm-harness-html
1m 25s
llm-harness-summary
9s
13h 53m 27s