Skip to content

Pull requests: abetlen/llama-cpp-python

New pull request New
Clear current search query, filters, and sorts
84 Open 438 Closed
84 Open 438 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

(WIP) Openapi client gen enhancement New feature or request
#144 opened May 3, 2023 by Stonelinks Loading…
3
added huggingface space implementation enhancement New feature or request
#146 opened May 3, 2023 by abhishekmamdapure Loading…
2
Add truncate to high level api enhancement New feature or request
#172 opened May 8, 2023 by SagsMug Loading…
1
WIP: Mechanism to retrieve all logprobs on completion enhancement New feature or request
#176 opened May 9, 2023 by tristanvdb Loading…
2
Allow relative paths at model initialization enhancement New feature or request
#198 opened May 12, 2023 by andreakiro Loading…
6
Added Mirostat Mode and related Params to Llama initialization
#329 opened Jun 6, 2023 by CoffeeVampir3 Loading…
3
Create server_streaming.py
#414 opened Jun 22, 2023 by zinccat Loading…
1
Implement a flake.nix that uses the upstream llama.cpp flake by reference
#517 opened Jul 23, 2023 by charles-dyfis-net Loading…
2
Create simple_local_chat.py
#575 opened Aug 5, 2023 by Mrgithub93 Loading…
5
Add parameter to skip saving to cache when caching is enabled
#594 opened Aug 10, 2023 by shaunabanana Loading…
Create Dockerfile-CN
#624 opened Aug 20, 2023 by Aincvy Loading…
Add Helm-Chart for easy Kubernetes deployment
#678 opened Sep 7, 2023 by 3deep5me Loading…
2
pyinstaller hook script
#709 opened Sep 13, 2023 by earonesty Loading…
15
gguf reader for layer and size estimates
#716 opened Sep 14, 2023 by earonesty Loading…
2
Add cancel() method to interrupt a stream
#733 opened Sep 18, 2023 by simonchatts Loading…
1
10
feat(llm-vscode): add generate endpoint to support llm-vscode
#843 opened Oct 24, 2023 by joennlae • Draft
limit_concurrency Uvicorn
#868 opened Nov 3, 2023 by RossAlRed Loading…
fix: get system message from messages for all prompt formats
#913 opened Nov 15, 2023 by julianullrich99 Loading…
1
Replace all absolute imports of llama_cpp in llama_cpp
#922 opened Nov 16, 2023 by JohanAR Loading…
1
Add batch inference support (WIP)
#951 opened Nov 28, 2023 by abetlen • Draft
3 tasks
2
10
Update shared library import & license compliance
#955 opened Nov 29, 2023 by D4ve-R Loading…
1
QA Document High api examples
#962 opened Dec 1, 2023 by zocainViken Loading…
Multistage CUDA Dockerfile to reduce image size and allow local repository build
#993 opened Dec 10, 2023 by peturparkur Loading…
6
explicit cast messages to string for RAG purposes
#1080 opened Jan 11, 2024 by nivibilla Loading…
4
Remove subsequences of cached tokens to match a longer prefix
#1106 opened Jan 19, 2024 by m42a Loading…
ProTip! Filter pull requests by the default branch with base:main.