Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

llm-cpp-build / linux-build-avxvnni

llm-cpp-build / linux-build-avx512

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, sym_int4, xpu)

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, truthfulqa, fp8, xpu)

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, arc, fp8, xpu)

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, winogrande, fp8, xpu)

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, winogrande, sym_int4, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, arc, fp8, xpu)

llm-harness-evaluation (3.11, Baichuan2-7B-Chat-LLaMAfied, arc, sym_int4, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, truthfulqa, sym_int4, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, truthfulqa, fp8, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, winogrande, sym_int4, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, winogrande, fp8, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, truthfulqa, sym_int4, xpu)

llm-harness-evaluation (3.11, falcon-7b-instruct-with-patch, arc, sym_int4, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, truthfulqa, fp8, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, winogrande, sym_int4, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, arc, fp8, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, winogrande, fp8, xpu)

llm-harness-evaluation (3.11, Llama2-7b-guanaco-dolphin-500, arc, sym_int4, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, arc, fp8, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, truthfulqa, fp8, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, arc, sym_int4, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, truthfulqa, sym_int4, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, winogrande, fp8, xpu)

llm-harness-evaluation (3.11, Mistral-7B-v0.1, winogrande, sym_int4, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, arc, fp8, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, arc, sym_int4, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, truthfulqa, fp8, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, truthfulqa, sym_int4, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, winogrande, fp8, xpu)

llm-harness-evaluation (3.11, mpt-7b-chat, winogrande, sym_int4, xpu)

llm-harness-summary

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Deprecation notice: v1, v2, and v3 of the artifact actions

The following artifacts were uploaded using a version of actions/upload-artifact that is scheduled for deprecation: "harness_results", "linux-amx", "linux-avx", "linux-avx2", "linux-avx512", "linux-avxvnni". Please update your workflow to use v4 of the artifact actions. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

llm-harness-html

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@f43a0e5ff2bd294095638e18286ca9a3d1956744, actions/setup-python@v4, actions/download-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Artifacts

Produced during runtime

Name	Size
harness_results Expired	16.1 KB
linux-amx Expired	4.29 MB
linux-avx Expired	2.24 MB
linux-avx2 Expired	2.18 MB
linux-avx512 Expired	4.22 MB
linux-avxvnni Expired	4.92 MB

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

LLM Harness Evaluation #515

Summary

LLM Harness Evaluation #515

Jobs

Run details

llm-harness-evaluation.yml

Annotations

Artifacts