-
Notifications
You must be signed in to change notification settings - Fork 17
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Dockerfile.ubi: use cuda-base as base for vllm-openai target #52
Conversation
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: dtrifiro The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Fixed upstream in vllm-project#5091
fixes RHOAIENG-8043 Co-authored-by: Chih-Chieh-Yang <[email protected]> Signed-off-by: Thomas Parnell <[email protected]>
8ba81b4
to
712ffff
Compare
this adds the cuda runtime in order to fix missing libcudart.so.12 on vLLM libraries
PR needs rebase. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
8a0593d
to
3c182aa
Compare
moved to #126 |
* fix __init__ files * make yapf happy
this adds the cuda runtime in order to fix missing libcudart.so.12 on vLLM libraries.