diff --git a/README.md b/README.md index 30f8c0b..5ebf832 100644 --- a/README.md +++ b/README.md @@ -30,6 +30,9 @@ pip install vllm python -m vllm.entrypoints.openai.api_server --model instructlab/granite-7b-lab --tensor-parallel-size 1 ``` +> Note: You may need to be specific about which Python version you use for your virtual environment. +> e.g. `python3.11 -m venv venv` is supported. + In another shell window ```shell @@ -104,4 +107,4 @@ eval_output/ └── reference_answer └── instructlab └── granite-7b-lab.jsonl -``` \ No newline at end of file +``` diff --git a/requirements.txt b/requirements.txt index 5174093..1779813 100644 --- a/requirements.txt +++ b/requirements.txt @@ -10,3 +10,4 @@ accelerate pandas pandas-stubs lm-eval>=0.4.2 +instructlab