Skip to content

Commit

Permalink
Update all in one benchmark readme (intel-analytics#9496)
Browse files Browse the repository at this point in the history
* Add gperftools install to all in one benchmark readme

* Update readme
  • Loading branch information
chtanch authored Nov 21, 2023
1 parent b234d7b commit daa8e9a
Showing 1 changed file with 7 additions and 0 deletions.
7 changes: 7 additions & 0 deletions python/llm/dev/benchmark/all-in-one/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,11 @@ pip install omegaconf
pip install pandas
```

Install gperftools to use libtcmalloc.so for MAX GPU to get better performance:
```bash
conda install -c conda-forge -y gperftools=2.10
```

## Config
Config YAML file has following format
```yaml
Expand Down Expand Up @@ -46,3 +51,5 @@ For SPR performance, run `bash run-spr.sh`.
> Please install torch nightly version to avoid `Illegal instruction (core dumped)` issue, you can follow the following command to install: `pip install --pre --upgrade torch --index-url https://download.pytorch.org/whl/nightly/cpu`
For ARC performance, run `bash run-arc.sh`.

For MAX GPU performance, run `bash run-max-gpu.sh`.

0 comments on commit daa8e9a

Please sign in to comment.