Skip to content

Commit

Permalink
Uing bigdl-llm-init instead of bigdl-nano-init (intel-analytics#9558)
Browse files Browse the repository at this point in the history
* Replace `bigdl-nano-init` with `bigdl-llm-init`.
* Install `bigdl-llm` instead of `bigdl-nano`.
* Remove nano in README.
  • Loading branch information
qiyuangong authored Nov 30, 2023
1 parent 34503ef commit d85a430
Show file tree
Hide file tree
Showing 58 changed files with 123 additions and 123 deletions.
4 changes: 2 additions & 2 deletions python/llm/example/CPU/Applications/hf-agent/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -43,8 +43,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ To run the examples, we recommend using Intel® Xeon® processors (server), or >
For OS, BigDL-LLM supports Ubuntu 20.04 or later, CentOS 7 or later, and Windows 10/11.

## Best Known Configuration on Linux
For better performance, it is recommended to set environment variables on Linux with the help of BigDL-Nano:
For better performance, it is recommended to set environment variables on Linux with the help of BigDL-LLM:
```bash
pip install bigdl-nano
source bigdl-nano-init
pip install bigdl-llm
source bigdl-llm-init
```
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down Expand Up @@ -118,8 +118,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down Expand Up @@ -119,8 +119,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -47,8 +47,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -70,8 +70,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -37,8 +37,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -38,8 +38,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -59,8 +59,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -42,8 +42,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -41,8 +41,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -32,8 +32,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -40,8 +40,8 @@ For optimal performance on server, it is recommended to set several environment

E.g. on Linux,
```bash
# set BigDL-Nano env variables
source bigdl-nano-init
# set BigDL-LLM env variables
source bigdl-llm-init

# e.g. for a server with 48 cores per socket
export OMP_NUM_THREADS=48
Expand Down
Loading

0 comments on commit d85a430

Please sign in to comment.