Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 5
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

343 Open 4,189 Closed
343 Open 4,189 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

llama binary release misses libaries. (ubuntu but perhaps others too)
#11893 opened Feb 15, 2025 by 0wwafa
1
Misc. bug: I tried to integrate this simple application(/examples/simple/) to my android application with UI interface(.apk), but the performance is degraded very drastically( like 2 seconds to 200 seconds). bug-unconfirmed
#11889 opened Feb 15, 2025 by Ramees025
[Tracker] Docker build fails on CI for arm64
#11888 opened Feb 15, 2025 by ngxson
2
Compile bug: Error while compile the llama.cpp - libggml-cuda.so: undefined reference to `log2f@GLIBC_2.27' bug-unconfirmed
#11877 opened Feb 14, 2025 by sakshi-joshi-handle
Compile bug: C++ One Definition Rule [-Wodr] violations in common/json.hpp bug-unconfirmed
#11876 opened Feb 14, 2025 by srcshelton
1
Feature Request: APIkey enhancement New feature or request
#11874 opened Feb 14, 2025 by gsm1258
4 tasks done
1
Feature Request: Use all (or configurable #) of threads for model loading, not constrainted by --threads specified for inference enhancement New feature or request
#11873 opened Feb 14, 2025 by VanceVagell
4 tasks done
2
Misc. bug: server metrics sometimes return "-nan" values
#11868 opened Feb 14, 2025 by aviallon
Misc. bug: Problems with official jinja templates (Gemma 2, Llama 3.2, Qwen 2.5) bug Something isn't working
#11866 opened Feb 14, 2025 by MoonRide303
@ochafik
7
Does llama.cpp deploy support mutil_nodes mutil-GPUs
#11865 opened Feb 14, 2025 by Tian14267
1
OLMoE Q4_0 quant does not work bug-unconfirmed
#11862 opened Feb 14, 2025 by l3utterfly
1
Misc. bug: Missing <think> tag in response (DeepSeek R1) bug-unconfirmed
#11861 opened Feb 14, 2025 by 9chu
2
how many rpc-host should I start on remote server
#11859 opened Feb 14, 2025 by vino5211
2
Compile bug: llama.cpp latest build fails on OmniOS with undefined symbol error bug-unconfirmed
#11857 opened Feb 14, 2025 by nmartin0
Eval bug: image encode time slow on mobile device bug-unconfirmed
#11856 opened Feb 14, 2025 by perp
Misc. bug: "response_format" on the OpenAI compatible "v1/chat/completions" issue bug-unconfirmed
#11847 opened Feb 13, 2025 by tulang3587
1
3
Misc. bug: CUDA error: CUDA-capable device(s) is/are busy or unavailable from cudaSetDevice(device) bug-unconfirmed
#11841 opened Feb 13, 2025 by wjkim00
cudaErrorIllegalAddress (error 700) due to "an illegal memory access was encountered" on CUDA API call to cudaDeviceSynchronize. bug-unconfirmed
#11829 opened Feb 12, 2025 by aginies
3
[BENCHMARKS] DeepScaleR-1.5B-Preview F16 ollama GGUF vs llama.cpp
#11828 opened Feb 12, 2025 by loretoparisi
3
Misc. bug: Quantization process 100 times slower on Windows (dockerized) bug-unconfirmed
#11825 opened Feb 12, 2025 by dclipca
Misc. bug: llama-cli crash on ubuntu with GGML-VULKAN=ON bug-unconfirmed
#11823 opened Feb 12, 2025 by gaykawadpk
1
Misc. bug: llama-server does not print model loading errors by default (log level misconfigured?) bug-unconfirmed
#11819 opened Feb 12, 2025 by akx
Misc. bug: webui: extreme sluggish performance typing into textarea with long-context conversations bug-unconfirmed
#11813 opened Feb 12, 2025 by woof-dog
Misc. bug: Native API failed. Native API returns: 20 (UR_RESULT_ERROR_DEVICE_LOST) bug-unconfirmed
#11812 opened Feb 12, 2025 by simonchen
Misc. bug: server not exit after missing result_output tensor error server
#11808 opened Feb 11, 2025 by ngxson
ProTip! Add no:assignee to see everything that’s not assigned.