Skip to content

Commit

Permalink
Add sample chat template into vLLM container
Browse files Browse the repository at this point in the history
  • Loading branch information
vaibhavjainwiz authored and dtrifiro committed Sep 13, 2024
1 parent 7c76447 commit 05dd581
Showing 1 changed file with 3 additions and 0 deletions.
3 changes: 3 additions & 0 deletions Dockerfile.ubi
Original file line number Diff line number Diff line change
Expand Up @@ -198,6 +198,9 @@ RUN umask 002 \

COPY LICENSE /licenses/vllm.md

# Copy only .jinja files from example directory to template directory
COPY examples/*.jinja /app/data/template/

USER 2000
ENTRYPOINT ["python3", "-m", "vllm.entrypoints.openai.api_server"]

Expand Down

0 comments on commit 05dd581

Please sign in to comment.