From 0dc0321ab7ea8af4048793bdc971d5836362c2aa Mon Sep 17 00:00:00 2001 From: sallyom Date: Mon, 26 Aug 2024 15:47:27 -0400 Subject: [PATCH] update README Signed-off-by: sallyom --- README.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/README.md b/README.md index 51023ba..e0f59a5 100644 --- a/README.md +++ b/README.md @@ -9,6 +9,8 @@ Python Library for Evaluation ## MT-Bench / MT-Bench-Branch Testing Steps +> **⚠️ Note:** Must use Python version 3.10 or later. + ```shell # Optional: Use cloud-instance.sh (https://github.com/instructlab/instructlab/tree/main/scripts/infra) to launch and setup the instance scripts/infra/cloud-instance.sh ec2 launch -t g5.4xlarge @@ -34,6 +36,7 @@ In another shell window ```shell export INSTRUCTLAB_EVAL_FIRST_N_QUESTIONS=10 # Optional if you want to shorten run times +# Commands relative to eval directory python3 tests/test_gen_answers.py python3 tests/test_branch_gen_answers.py ``` @@ -104,4 +107,4 @@ eval_output/ └── reference_answer └── instructlab └── granite-7b-lab.jsonl -``` \ No newline at end of file +```