Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

updated from 0.2.90 to 0.3.2 and now my GPU won't load #1835

Open
rookiemann opened this issue Nov 17, 2024 · 1 comment
Open

updated from 0.2.90 to 0.3.2 and now my GPU won't load #1835

rookiemann opened this issue Nov 17, 2024 · 1 comment

Comments

@rookiemann
Copy link

I've looked through the issues, I do see there are some complaints about this, a lot of different ways to fix it working differently for different users.

Is there a unified, accepted and tested way that can readjust my set up to work with GPUs?

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Wed_Feb__8_05:53:42_Coordinated_Universal_Time_2023
Cuda compilation tools, release 12.1, V12.1.66
Build cuda_12.1.r12.1/compiler.32415258_0

@rookiemann
Copy link
Author

I revert back to this:
pip install --force-reinstall --no-cache-dir llama-cpp-python==0.2.90 --extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cu121

It's working again, so it must be something in update I'm missing

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant