Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 14
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
144 Open 2,008 Closed
144 Open 2,008 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Misc. bug: llama-server webui overriding command line parameters bug-unconfirmed
#13277 opened May 3, 2025 by merc4derp
Compile bug: nvcc fatal : Unsupported gpu architecture 'compute_120' bug-unconfirmed
#13271 opened May 2, 2025 by jacekpoplawski
5
Misc. bug: Server does not always cancel requests for disconnected connections bug-unconfirmed
#13262 opened May 2, 2025 by CyberShadow
Misc. bug: the output file of llama-quantize is not gguf format bug-unconfirmed
#13258 opened May 2, 2025 by samsosu
Eval bug: sentencepiece tokenizer generates incorrect tokens bug-unconfirmed
#13256 opened May 2, 2025 by taylorchu
1
Eval bug: ggml_cuda_compute_forward: MUL_MAT failed when using FA + MLA on DeepSeekv3 0324, on mixed CPU + GPU bug-unconfirmed
#13252 opened May 2, 2025 by Panchovix
1
When using the qwen2.5-vl model on AMD Ryzen APU under Windows, the error "failed to allocate Vulkan0 buffer of size 4342230552" may appear. bug-unconfirmed
#13250 opened May 2, 2025 by xeden3
Misc. bug: terminate called after throwing an instance of 'vk::DeviceLostError' bug-unconfirmed
#13248 opened May 1, 2025 by Som-anon
Eval bug: -sm row causes GGML_ASSERT fail in Llama 4 Scout bug-unconfirmed
#13240 opened May 1, 2025 by FullstackSensei
1
Eval bug: Qwen3-30B-A3B-Q4_K_M: Vulkan ~10% slower than AVX2 bug-unconfirmed
#13217 opened Apr 30, 2025 by ZUIcat
3
Eval bug: Qwen3 30B A3B is slow with CUDA bug-unconfirmed
#13211 opened Apr 30, 2025 by Nepherpitou
1
Eval bug: Can't utilize all 16 threads / 8 CPU cores for prompt processing when using llama-server. works fine with llama-cli bug-unconfirmed
#13197 opened Apr 29, 2025 by c777s
2
Eval bug: Persistent <think> Tags in Qwen3-32B Output Despite enable_thinking: False and --reasoning-format none in llama.cpp bug-unconfirmed
#13189 opened Apr 29, 2025 by shyn01
1
Misc. bug: rpc-server crash without cache bug-unconfirmed
#13185 opened Apr 29, 2025 by hbuxiaofei
1
Misc. bug: llama-parallel segmentation fault bug-unconfirmed
#13172 opened Apr 29, 2025 by gnusupport
Eval bug: Qwen3 30B A3B Q4_0 failed to run bug-unconfirmed
#13168 opened Apr 29, 2025 by riteme
1
Eval bug: Unreadable output when using qwen2-vl model. bug-unconfirmed
#13165 opened Apr 29, 2025 by hedy881028
Misc. bug: Qwen3 30B A3B Q4_K_M loads on server but quickly dies after requesting inference through Llama.cpp web UI bug-unconfirmed
#13164 opened Apr 29, 2025 by sidran
18
Eval bug: Qwen3 Q4_0 not working with SYCL bug-unconfirmed
#13163 opened Apr 29, 2025 by invent00
4
Eval bug: SIGILL bug-unconfirmed
#13161 opened Apr 29, 2025 by KTibow
2
Misc. bug: Qwen 3.0 "enable_thinking" parameter not working bug-unconfirmed
#13160 opened Apr 29, 2025 by celsowm
1
6
bug: ValueError: Architecture qwen3 not supported bug-unconfirmed
#13157 opened Apr 28, 2025 by JohnConnor123
10
Misc. bug: Shared libraries don't properly contain /common/ functions bug-unconfirmed
#13156 opened Apr 28, 2025 by kinchahoy
1
5
Misc. bug: Flash Attention not working on CDNA3 ROCm 6.4 MI300 bug-unconfirmed
#13145 opened Apr 28, 2025 by unclemusclez
Eval bug: EXAONE fails to run with quantized KV cache bug-unconfirmed
#13121 opened Apr 26, 2025 by AdamNiederer
ProTip! Adding no:label will show everything without a label.