Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open 1
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
12 Open 27 Closed
12 Open 27 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Include in Readme how to Pass Custom Arguments to llama_cpp.server in Docker documentation Improvements or additions to documentation question Further information is requested
#1029 opened Dec 19, 2023 by jaredquekjz
6
CUDA/Windows instructions do not work; there is no setup.py bug Something isn't working documentation Improvements or additions to documentation
#965 opened Dec 2, 2023 by andymartin
1
[BUG] Server cant handle two streaming connections in same time bug Something isn't working documentation Improvements or additions to documentation
#897 opened Nov 10, 2023 by ArtyomZemlyak
4 tasks done
5
Raise Error "no CUDA-capable device is detected" when running a CUBLAS compiled version of llama-cpp-python bug Something isn't working documentation Improvements or additions to documentation
#880 opened Nov 6, 2023 by bonuschild
13
Unable to install llama-cpp-python Package in Python - Wheel Building Process gets Stuck bug Something isn't working build documentation Improvements or additions to documentation
#853 opened Oct 30, 2023 by Illanser
5
(mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')) on M2 bug Something isn't working build documentation Improvements or additions to documentation
#847 opened Oct 27, 2023 by alessandropaticchio
19
One chat prompt/template should be customizable from runtime - the prompt I need atm documentation Improvements or additions to documentation
#816 opened Oct 12, 2023 by pervrosen
7
Documentation of server command line parameters. documentation Improvements or additions to documentation
#635 opened Aug 24, 2023 by arthurwolf
7
Document plug-n-play docker setup documentation Improvements or additions to documentation enhancement New feature or request
#495 opened Jul 18, 2023 by abetlen
Roadmap for v0.2 documentation Improvements or additions to documentation enhancement New feature or request
#487 opened Jul 18, 2023 by abetlen
8 of 9 tasks
1
CUBLAS and CLBLAST builds on Windows documentation Improvements or additions to documentation duplicate This issue or pull request already exists windows A Windoze-specific issue
#463 opened Jul 9, 2023 by goodglitch
6
Log llama.cpp commit hash when installing using --verbose documentation Improvements or additions to documentation enhancement New feature or request llama.cpp Problem with llama.cpp shared lib
#256 opened May 21, 2023 by gjmulder
1
ProTip! no:milestone will show everything without a milestone.