Skip to content

Issues: ggerganov/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 1
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
8 Open 51 Closed
8 Open 51 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Smooth Sampling / Quadratic Sampling support generation quality Quality of model output performance Speed related topics Review Complexity : High Generally require indepth knowledge of LLMs or GPUs
#6445 opened Apr 2, 2024 by kalomaze Loading…
12
P-Step Truncation Sampling generation quality Quality of model output need feedback Testing and feedback with results are needed refactoring Refactoring Review Complexity : High Generally require indepth knowledge of LLMs or GPUs
#5675 opened Feb 23, 2024 by p-e-w Loading…
11
[RFC] common, server : add top-a sampler enhancement New feature or request generation quality Quality of model output Review Complexity : High Generally require indepth knowledge of LLMs or GPUs
#5612 opened Feb 20, 2024 by Artefact2 Loading…
Penalty threshold: A mechanism for improving repetition penalties enhancement New feature or request generation quality Quality of model output Review Complexity : Medium Generally require more time to grok but manageable by beginner to medium expertise level
#5561 opened Feb 18, 2024 by p-e-w Loading…
14
llama : combined beam search + grammar sampling strategy generation quality Quality of model output good first issue Good for newcomers research 🔬
#2923 opened Aug 31, 2023 by ggerganov
9
llama : tool for evaluating quantization results per layer enhancement New feature or request generation quality Quality of model output
#2783 opened Aug 25, 2023 by ggerganov
8
Implementation of a sequence repetition penalty sampler enhancement New feature or request generation quality Quality of model output need feedback Testing and feedback with results are needed
#2593 opened Aug 12, 2023 by KerfuffleV2 • Draft
57
Study how LM Evaluation Harness works and try to implement it enhancement New feature or request generation quality Quality of model output help wanted Extra attention is needed high priority Very important issue research 🔬
#231 opened Mar 17, 2023 by ggerganov
5
ProTip! Adding no:label will show everything without a label.