Skip to content

Issues: ggerganov/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 1
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
37 Open 82 Closed
37 Open 82 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

web UI : support syntax highlighting enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#10246 opened Nov 10, 2024 by slaren
2
Bug: llama-server web UI resets the text selection during inference on every token update bug Something isn't working good first issue Good for newcomers help wanted Extra attention is needed low severity Used to report low severity bugs in llama.cpp (e.g. cosmetic issues, non critical UI glitches)
#9608 opened Sep 23, 2024 by mashdragon
2
Bug: gguf pypi package corrupts environment bug Something isn't working help wanted Extra attention is needed high severity Used to report high severity bugs in llama.cpp (Malfunctioning hinder important workflow)
#9566 opened Sep 20, 2024 by vladmandic
2
Refactor: Add more typechecking to GGUFWriter.add_key_value help wanted Extra attention is needed refactoring Refactoring
#9095 opened Aug 19, 2024 by mofosyne
Improve cvector-generator enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#8724 opened Jul 27, 2024 by ngxson
33
Feature Request: Installable package via winget enhancement New feature or request help wanted Extra attention is needed
#8188 opened Jun 28, 2024 by ngxson
4 tasks done
8
ggml : add WebGPU backend help wanted Extra attention is needed research 🔬
#7773 opened Jun 5, 2024 by ggerganov
5
ggml : add DirectML backend help wanted Extra attention is needed research 🔬
#7772 opened Jun 5, 2024 by ggerganov
8
Refactor: Existing examples refactoring opportunities help wanted Extra attention is needed refactoring Refactoring
#7559 opened May 27, 2024 by mofosyne
3 tasks
Fix self extend on the server. examples help wanted Extra attention is needed Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix server
#7239 opened May 12, 2024 by Maximilian-Winter • Draft
3
Add token healing to main and server enhancement New feature or request examples help wanted Extra attention is needed need feedback Testing and feedback with results are needed Review Complexity : High Generally require indepth knowledge of LLMs or GPUs server
#7187 opened May 9, 2024 by mare5x Loading…
3
Should we add an autolabeler for PR? devops improvements to build systems and github actions enhancement New feature or request help wanted Extra attention is needed
#7174 opened May 9, 2024 by mofosyne
@mofosyne
2
ggml : add GPU support for Mamba models enhancement New feature or request help wanted Extra attention is needed Nvidia GPU Issues specific to Nvidia GPUs
#6758 opened Apr 19, 2024 by ggerganov
24
Inference not running when using a tokenizer with word model bug Something isn't working help wanted Extra attention is needed
#6717 opened Apr 17, 2024 by AI-Guru
6
server: process prompt fairly accross slots enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed server/webui
#6607 opened Apr 11, 2024 by phymbert
1
Server: Add prompt processing progress endpoint? enhancement New feature or request help wanted Extra attention is needed server/webui
#6586 opened Apr 10, 2024 by stduhpf
8
kubernetes example enhancement New feature or request help wanted Extra attention is needed kubernetes Helm & Kubernetes server/webui
#6546 opened Apr 8, 2024 by phymbert
@OmegAshEnr01n
16
common: download from URL, improve parallel download progress status enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed split GGUF split model sharding
#6537 opened Apr 8, 2024 by phymbert
1
@TevinWang
6
Question: How to generate an MPS gputrace help wanted Extra attention is needed high priority Very important issue
#6506 opened Apr 5, 2024 by tomsanbear
10
Feature Request: Task Cancellation on Client Disconnection enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed server/webui
#6421 opened Apr 1, 2024 by redlion0929
4 tasks done
@rahsuri
4
server: doc: document the --defrag-thold option documentation Improvements or additions to documentation enhancement New feature or request help wanted Extra attention is needed server/webui
#6293 opened Mar 25, 2024 by phymbert
server: exit failure if --embedding is set with an incoherent --ubatch-size enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed server/webui
#6263 opened Mar 23, 2024 by phymbert
5
split: include the option in ./convert.py and quantize enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed split GGUF split model sharding
#6260 opened Mar 23, 2024 by phymbert
9
split: allow --split-max-size option enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed split GGUF split model sharding
#6259 opened Mar 23, 2024 by phymbert
1
1
llava-cli: improve llava-cli and the API for using LLaVA enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed llava LLaVa and multimodal
#6027 opened Mar 12, 2024 by phymbert
@ggerganov
4
ProTip! Type g i on any issue or pull request to go back to the issue listing page.