Skip to content

Issues: ggerganov/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 1
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 9
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

255 Open 3,922 Closed
255 Open 3,922 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Misc. bug: since 235f6e1 llama-server's main.js overwrites Authorization header so Web UI fails behind authenticating reverse proxy bug-unconfirmed
#10854 opened Dec 16, 2024 by vesath
Misc. bug: llama-bench SEGFAULTS w/ SYCL/HIP backend, however llama-cli seems to work bug-unconfirmed
#10850 opened Dec 16, 2024 by lhl
6
Compile bug: Compiling on Maxwell architecture 52 cuda12.7 bug-unconfirmed
#10849 opened Dec 16, 2024 by envolution
Feature Request: Q6_0 quant enhancement New feature or request
#10848 opened Dec 16, 2024 by Nexesenex
4 tasks done
Eval bug: ggml_metal_encode_node: error: unsupported op 'IM2COL' bug-unconfirmed
#10845 opened Dec 16, 2024 by beginor
Eval bug: Qwen2-VL Hallucinates image content on Vulkan backend bug-unconfirmed
#10843 opened Dec 15, 2024 by stduhpf
12
Misc. bug: JS error when using the web ui on iPhone bug Something isn't working server/webui
#10842 opened Dec 15, 2024 by ggerganov
1
Misc. bug: Server Demo on Mac, safari return error bug-unconfirmed
#10841 opened Dec 15, 2024 by DickyQi
1
1
Feature Request: Add support for the WePOINTS/POINTS1.5 model enhancement New feature or request
#10834 opened Dec 15, 2024 by rcbevans
4 tasks done
Misc. bug: llama 3.2 3B : for Q4 quantized models repeated output is generating without hitting [end of text] bug-unconfirmed
#10824 opened Dec 14, 2024 by Ramees025
3
Is LayerSkip / self-speculative decoding possible (requires getting one intermediate layer's output + some KV cache changes)?
#10820 opened Dec 13, 2024 by tc-wolf
Feature Request: Allow Filtering LLama Server Response Fields enhancement New feature or request good first issue Good for newcomers
#10819 opened Dec 13, 2024 by mcmah309
4 tasks done
4
Feature Request: Support for C4AI Command R7B / Cohere2ForCausalLM enhancement New feature or request
#10816 opened Dec 13, 2024 by arch-btw
4 tasks done
1
Feature Request: Add support for Phi-4 model enhancement New feature or request
#10814 opened Dec 13, 2024 by fairydreaming
4 tasks done
1
Eval bug: GGML_ASSERT((qs.n_attention_wv == n_attn_layer) && "n_attention_wv is unexpected") failed Could not attach to process. bug-unconfirmed
#10799 opened Dec 12, 2024 by hissain
3
Error while using llama-quantize with Meta-Llama-3.1-8B-Instruct bug-unconfirmed
#10793 opened Dec 12, 2024 by ajitwadekar
terminate called after throwing an instance of 'std::out_of_range' what(): _Map_base::at Aborted (core dumped)
#10790 opened Dec 12, 2024 by kkkwjr
3
Eval bug: CANN error E89999 on Ascend 910b bug-unconfirmed
#10777 opened Dec 11, 2024 by JerryKwan
Misc. bug: --cfg-negative-prompt is gone bug-unconfirmed
#10774 opened Dec 11, 2024 by l29ah
1
Misc. bug: Virus detected bug-unconfirmed
#10768 opened Dec 10, 2024 by DrVonSinistro
16
Eval bug: llama-3.2-3B got error loading model: done_getting_tensors: wrong number of tensors; expected 255, got 254 bug-unconfirmed
#10759 opened Dec 10, 2024 by franklyd
1
Feature Request: Source code highlight and math formula rendering enhancement New feature or request
#10758 opened Dec 10, 2024 by xintq
4 tasks done
16
Misc. bug: Q4_0 with runtime repacking not working as expected (TYPE_Q4_0_4_4 REMOVED) bug-unconfirmed
#10757 opened Dec 10, 2024 by smpurkis
20
Feature Request: Performance enhancement in ARM CPU (Kunpeng 920) enhancement New feature or request
#10754 opened Dec 10, 2024 by feikiss
4 tasks done
Compile bug: ios swift xcode build error when upgrade to llama : use cmake for swift build bug-unconfirmed
#10747 opened Dec 10, 2024 by jiabochao
6
ProTip! Type g i on any issue or pull request to go back to the issue listing page.