Skip to content

Commit

Permalink
update README, requirements.txt
Browse files Browse the repository at this point in the history
Signed-off-by: James Kunstle <[email protected]>
  • Loading branch information
JamesKunstle committed Jun 26, 2024
1 parent f75a9e2 commit 4949bf0
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,9 @@ pip install vllm
python -m vllm.entrypoints.openai.api_server --model instructlab/granite-7b-lab --tensor-parallel-size 1
```

> Note: You may need to be specific about which Python version you use for your virtual environment.
> e.g. `python3.11 -m venv venv` is supported.
In another shell window

```shell
Expand Down Expand Up @@ -104,4 +107,4 @@ eval_output/
└── reference_answer
└── instructlab
└── granite-7b-lab.jsonl
```
```
1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -10,3 +10,4 @@ accelerate
pandas
pandas-stubs
lm-eval>=0.4.2
instructlab

0 comments on commit 4949bf0

Please sign in to comment.