Skip to content

Issues: ggerganov/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 1
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 7
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
6 Open 7 Closed
6 Open 7 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Feature Request: Tensor Parallelism support enhancement New feature or request threading Parallel processing and thread management
#9086 opened Aug 19, 2024 by ClarkChin08
4 tasks done
6
ggml : spread compute across threads in chunks demo Demonstrate some concept or idea, not intended to be merged threading Parallel processing and thread management
#1507 opened May 17, 2023 by ggerganov Loading…
6
Use Threadpool to schedule the work threading Parallel processing and thread management
#851 opened Apr 8, 2023 by howard0su • Draft
8
Run several single thread operators parellel threading Parallel processing and thread management
#850 opened Apr 8, 2023 by howard0su Loading…
7
Optimize locking behavior threading Parallel processing and thread management
#813 opened Apr 6, 2023 by janekb04 Loading…
19
Add "-e"/"--eval-threads" to distinguish thread counts for single-token eval and prompt eval threading Parallel processing and thread management
#744 opened Apr 3, 2023 by MagisterLuddite • Draft
10
ProTip! Adding no:label will show everything without a label.