Skip to content

Commit

Permalink
Update to vLLM Blog
Browse files Browse the repository at this point in the history
  • Loading branch information
clintg6 authored and Danny213123 committed Oct 22, 2024
1 parent cb0d0c2 commit b9cbef1
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions blogs/artificial-intelligence/vllm-optimize/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -49,11 +49,7 @@ To access the latest vLLM features in ROCm 6.2, clone the vLLM repository, modif

```bash
git clone https://github.com/vllm-project/vllm.git
git checkout 0f961b3
cd vllm
sed -i '/^ARG BASE_IMAGE=/c\ARG BASE_IMAGE="rocm/pytorch:rocm6.2_ubuntu20.04_py3.9_pytorch_release_2.3.0"' Dockerfile.rocm
LINE_NUMBER=$(grep -n "ENV LLVM_SYMBOLIZER_PATH=/opt/rocm/llvm/bin/llvm-symbolizer" Dockerfile.rocm | cut -d: -f1)
sed -i "${LINE_NUMBER}i RUN python3 -m pip uninstall -y torch torchvision && python3 -m pip install --no-cache-dir --pre torch torchvision --index-url https://download.pytorch.org/whl/nightly/rocm6.2/" Dockerfile.rocm
DOCKER_BUILDKIT=1 docker build -f Dockerfile.rocm -t vllm-rocm .
```

Expand Down

0 comments on commit b9cbef1

Please sign in to comment.