Skip to content
LLM Harness Evaluation

LLM Harness Evaluation #387

Sign in to view logs

LLM Harness Evaluation

LLM Harness Evaluation #387

Run time

Learn about OS pricing on GitHub Actions
Job Run time
set-matrix
1s
set-matrix
1s
llm-cpp-build / check-linux-avx512-artifact
2s
llm-cpp-build / check-linux-avx512-artifact
2s
llm-cpp-build / check-linux-amx-artifact
3s
llm-cpp-build / check-linux-amx-artifact
3s
llm-cpp-build / check-linux-avxvnni-artifact
2s
llm-cpp-build / check-linux-avxvnni-artifact
2s
llm-cpp-build / check-windows-avx2-artifact
0s
llm-cpp-build / check-windows-avx2-artifact
0s
llm-cpp-build / check-windows-avx-artifact
0s
llm-cpp-build / check-windows-avx-artifact
0s
llm-cpp-build / check-windows-avx-vnni-artifact
0s
llm-cpp-build / check-windows-avx-vnni-artifact
0s
llm-cpp-build / windows-build-avx2
0s
llm-cpp-build / windows-build-avx2
0s
llm-cpp-build / windows-build-avx
0s
llm-cpp-build / windows-build-avx
0s
llm-cpp-build / windows-build-avx-vnni
0s
llm-cpp-build / windows-build-avx-vnni
0s
llm-cpp-build / linux-build-avx512
2m 13s
llm-cpp-build / linux-build-avx512
2m 13s
llm-cpp-build / linux-build-avxvnni
2m 0s
llm-cpp-build / linux-build-avxvnni
2m 0s
llm-cpp-build / linux-build-amx
54s
llm-cpp-build / linux-build-amx
54s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)
52m 34s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)
52m 34s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)
53m 55s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)
53m 55s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)
24m 32s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)
24m 32s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)
26m 33s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)
26m 33s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)
12m 58s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)
12m 58s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)
13m 3s
llm-harness-evaluation (3.9, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)
13m 3s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)
40m 38s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)
40m 38s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, fp8, xpu)
42m 45s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, arc, fp8, xpu)
42m 45s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)
21m 10s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)
21m 10s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)
23m 13s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)
23m 13s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)
11m 11s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)
11m 11s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)
11m 57s
llm-harness-evaluation (3.9, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)
11m 57s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, sym_int4, xpu)
47m 51s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, sym_int4, xpu)
47m 51s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, fp8, xpu)
49m 34s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, arc, fp8, xpu)
49m 34s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)
23m 30s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)
23m 30s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, fp8, xpu)
24m 51s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, truthfulqa, fp8, xpu)
24m 51s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, sym_int4, xpu)
12m 57s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, sym_int4, xpu)
12m 57s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, fp8, xpu)
13m 1s
llm-harness-evaluation (3.9, Mistral-7B-v0.1, winogrande, fp8, xpu)
13m 1s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, sym_int4, xpu)
51m 14s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, sym_int4, xpu)
51m 14s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, fp8, xpu)
52m 12s
llm-harness-evaluation (3.9, mpt-7b-chat, arc, fp8, xpu)
52m 12s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, sym_int4, xpu)
21m 48s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, sym_int4, xpu)
21m 48s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, fp8, xpu)
23m 26s
llm-harness-evaluation (3.9, mpt-7b-chat, truthfulqa, fp8, xpu)
23m 26s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, sym_int4, xpu)
12m 9s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, sym_int4, xpu)
12m 9s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, fp8, xpu)
12m 22s
llm-harness-evaluation (3.9, mpt-7b-chat, winogrande, fp8, xpu)
12m 22s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)
49m 15s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)
49m 15s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)
50m 37s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)
50m 37s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)
24m 9s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)
24m 9s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)
13h 34m 38s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)
25m 55s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)
12m 27s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)
12m 27s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)
13m 12s
llm-harness-evaluation (3.9, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)
13m 12s
llm-harness-summary
20s
llm-harness-summary
17s
llm-harness-html
1s
llm-harness-html
52s
1d 17h 50m 41s