Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

468 Open 681 Closed
468 Open 681 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Mambaforge breaks cuda builds, switch to miniforge?
#1870 opened Dec 16, 2024 by fat-tire
chatml-function-callling not adding tool description to the prompt.
#1869 opened Dec 16, 2024 by undo76
It seems that LlamaSamplingContext is no longer in use.
#1866 opened Dec 16, 2024 by Taiki-azrs
Confusion regarding operation/terminology of speculative decoding and sampling
#1865 opened Dec 15, 2024 by MushroomHunting
1
Crash due to "The current task is not holding this lock" when {"stream": true}
#1861 opened Dec 11, 2024 by Ian321
4 tasks done
2
1
Add an option to enable --runtime-repack in llama.cpp
#1860 opened Dec 9, 2024 by ekcrisp
2
server chat/completion api fails - coroutine object not callable in llama_proxy
#1857 opened Dec 9, 2024 by PurnaChandraPanda
3
"tool_calls" not returning on native http request on a llama cpp server
#1856 opened Dec 7, 2024 by celsowm
4 tasks done
llama_get_logits_ith: invalid logits id -1, reason: no logits
#1855 opened Dec 7, 2024 by devashishraj
4 tasks done
Request to publish CUDA builds for v0.3.2 to GitHub Releases
#1854 opened Dec 5, 2024 by lsorber
2
With Intel GPU on Windows, llama_perf_context_print reports invalid performance metrics
#1853 opened Dec 2, 2024 by dnoliver
4 tasks done
Windows with Intel GPU fails to build if Ninja is not the selected backend
#1852 opened Dec 2, 2024 by dnoliver
4 tasks done
Intel GPU not enabled when using -DLLAVA_BUILD=OFF
#1851 opened Dec 2, 2024 by dnoliver
4 tasks done
[INFORMATION REQUEST] Is it possible to build for GPU enabled target on non-GPU host?
#1841 opened Nov 25, 2024 by m-o-leary
Prebuilt cuda wheel has a GLIBC version mismatch on Ubuntu 20.04.
#1840 opened Nov 25, 2024 by Moon-404
Error when building wheels on Linux FileNotFoundError: [Errno 2] No such file or directory: 'ninja'`
#1839 opened Nov 23, 2024 by sabaimran
4 tasks done
2
updated from 0.2.90 to 0.3.2 and now my GPU won't load
#1835 opened Nov 17, 2024 by rookiemann
1
"eval time" and "prompt eval time" is 0.00ms after Ver0.3.0
#1830 opened Nov 12, 2024 by nai-kon
1
sys:1: ResourceWarning: unclosed file <_io.TextIOWrapper name='nul' mode='w' encoding='cp932'>
#1828 opened Nov 11, 2024 by AkiraRy
llama-server not using GPU
#1826 opened Nov 9, 2024 by RakshitAralimatti
Prebuilt CUDA wheels not working
#1822 opened Nov 5, 2024 by mjwweb
2
AttributeError: function 'llama_sampler_init_tail_free' not found after compiling llama.pcc with hipBLAS
#1818 opened Oct 30, 2024 by Micromanner
2
Specify GPU Selection (e.g., CUDA:0, CUDA:1)
#1816 opened Oct 30, 2024 by RakshitAralimatti
4
[Feature request] High-level API support for DRY and XTC samplers
#1813 opened Oct 28, 2024 by ddh0
3
llama_get_logits_ith: invalid logits id -1, reason: no logits
#1812 opened Oct 28, 2024 by ba0gu0
2
ProTip! Follow long discussions with comments:>50.