Search results

Tool call support (Llama 3.x, Functionary v3, Hermes 2 Pro, Mistral Nemo, generic) w/ lazy grammars

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

examples

pythonpython script changespython script changes

scriptScript relatedScript related

server

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggerganov/llama.cppnumber 9639

#9639 In ggerganov/llama.cpp;

· ochafik opened on Sep 25, 2024

Direct I/O and Transparent HugePages

demoDemonstrate some concept or idea, not intended to be mergedDemonstrate some concept or idea, not intended to be merged

examples

pythonpython script changespython script changes

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

scriptScript relatedScript related

server

Status: Open (in progress).

ggerganov/llama.cppnumber 7420

#7420 In ggerganov/llama.cpp;

· pavelfatin opened on May 20, 2024

Create run.py

enhancementNew feature or requestNew feature or request

obsolete?Marker for potentially obsolete PRMarker for potentially obsolete PR

pythonpython script changespython script changes

Review Complexity : LowTrivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fixTrivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix

scriptScript relatedScript related

Status: Open (in progress).

ggerganov/llama.cppnumber 1204

#1204 In ggerganov/llama.cpp;

· jdpsl opened on Apr 27, 2023

llama : tokenizer unicode codepoint categories

pythonpython script changespython script changes

Review Complexity : MediumGenerally require more time to grok but manageable by beginner to medium expertise levelGenerally require more time to grok but manageable by beginner to medium expertise level

scriptScript relatedScript related

testingEverything test relatedEverything test related

Status: Open (in progress).

ggerganov/llama.cppnumber 8606

#8606 In ggerganov/llama.cpp;

· jaime-m-p opened on Jul 20, 2024

add FP8 support to gguf/llama:

buildCompilation issuesCompilation issues

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

scriptScript relatedScript related

Tensor Encoding Schemehttps://github.com/ggerganov/llama.cpp/wiki/Tensor-Encoding-Schemeshttps://github.com/ggerganov/llama.cpp/wiki/Tensor-Encoding-Schemes

testingEverything test relatedEverything test related

Status: Draft (not ready).

ggerganov/llama.cppnumber 10055

#10055 In ggerganov/llama.cpp;

· Djip007 opened on Oct 26, 2024

Revert "ggml : remove OpenCL (#7735) + (#8235)"

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

buildCompilation issuesCompilation issues

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

nixIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deploymentIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment

pythonpython script changespython script changes

scriptScript relatedScript related

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

Status: Draft (not ready).

ggerganov/llama.cppnumber 8986

#8986 In ggerganov/llama.cpp;

· okias opened on Aug 11, 2024