Skip to content
LLM Harness Evaluation

LLM Harness Evaluation #393

Sign in to view logs

LLM Harness Evaluation

LLM Harness Evaluation #393

Run time

Learn about OS pricing on GitHub Actions
Job Run time
set-matrix
1s
llm-cpp-build / check-linux-amx-artifact
8s
llm-cpp-build / check-linux-avx512-artifact
2s
llm-cpp-build / check-linux-avxvnni-artifact
2s
llm-cpp-build / check-windows-avx-artifact
0s
llm-cpp-build / check-windows-avx2-artifact
0s
llm-cpp-build / check-windows-avx-vnni-artifact
0s
llm-cpp-build / windows-build-avx
0s
llm-cpp-build / windows-build-avx-vnni
0s
llm-cpp-build / windows-build-avx2
0s
llm-cpp-build / linux-build-avx512
2m 15s
llm-cpp-build / linux-build-avxvnni
2m 0s
llm-cpp-build / linux-build-amx
51s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)
51m 57s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)
54m 12s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)
24m 58s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)
26m 14s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)
13m 17s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)
13m 49s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)
40m 52s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, fp8, xpu)
42m 56s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)
21m 36s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)
22m 35s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)
11m 44s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)
12m 31s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, sym_int4, xpu)
49m 38s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, fp8, xpu)
51m 22s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)
24m 5s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, fp8, xpu)
25m 46s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, sym_int4, xpu)
12m 40s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, fp8, xpu)
13m 9s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, sym_int4, xpu)
51m 21s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, fp8, xpu)
52m 39s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, sym_int4, xpu)
21m 43s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, fp8, xpu)
23m 19s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, sym_int4, xpu)
12m 7s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, fp8, xpu)
11m 57s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)
50m 43s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)
52m 4s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)
25m 0s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)
26m 23s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)
13m 1s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)
13m 50s
llm-harness-html
52s
llm-harness-summary
16s
14h 33m 55s