Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open 1
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
8 Open 12 Closed
8 Open 12 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Newlines in generation when using grammar model Model specific issue quality Quality of model output
#637 opened Aug 24, 2023 by rlancemartin
4
Different generation in llama.cpp and llama-cpp-python model Model specific issue quality Quality of model output
#619 opened Aug 17, 2023 by ssemeniuta
13
Output of emojis seems to be somewhat broken bug Something isn't working quality Quality of model output
#608 opened Aug 13, 2023 by thomasfowler
3
Gibberish responses with Llama-2-13B model Model specific issue quality Quality of model output
#596 opened Aug 10, 2023 by rlleshi
9
Classifier-free guidance enhancement New feature or request quality Quality of model output
#506 opened Jul 19, 2023 by abb128
2
give different answer for the same question between llama.cpp‘s main.exe and this project quality Quality of model output
#384 opened Jun 16, 2023 by zhiyixu
4 tasks done
8
Prompt for instruction models to be used in server model Model specific issue quality Quality of model output
#383 opened Jun 16, 2023 by lucasjinreal
4
Potential problem with streaming and unicode bug Something isn't working quality Quality of model output
#372 opened Jun 13, 2023 by iactix
18
ProTip! Updated in the last three days: updated:>2025-05-22.