Skip to content

Issues: ggml-org/llama.cpp

changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 15
tutorials : list for llama.cpp
#13523 opened May 14, 2025 by ggerganov
Open 3
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Issues list

OpenCL: Add group_norm, concat, tsembd, upscale, tanh, pad and repeat ggml changes relating to the ggml tensor library for machine learning
#13781 opened May 25, 2025 by rmatif Loading…
ggml-backend: backend-agnostic tensor parallelism ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13776 opened May 25, 2025 by JohannesGaessler Draft
ggml : add ggml_fill() ggml changes relating to the ggml tensor library for machine learning testing Everything test related
#13772 opened May 25, 2025 by ngxson Loading…
vulkan: readd GGML_VULKAN_PERF ggml changes relating to the ggml tensor library for machine learning Vulkan Issues specific to the Vulkan backend
#13761 opened May 24, 2025 by netrunnereve Loading…
SYCL: Add mrope kernel ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13755 opened May 24, 2025 by qnixsynapse Loading…
SYCL: add gelu_erf kernel ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13749 opened May 24, 2025 by qnixsynapse Loading…
SYCL: Implement few same quantized type copy kernels ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13739 opened May 24, 2025 by qnixsynapse Loading…
remove templates from soft_max_f32_submitter to allow SYCL graph updates ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13724 opened May 23, 2025 by lslusarczyk Loading…
ggml : riscv: add xtheadvector support ggml changes relating to the ggml tensor library for machine learning
#13720 opened May 23, 2025 by xctan Loading…
add GGML_USE_NUMA_MIGRATE feature to optimize cross NUMA op computation examples ggml changes relating to the ggml tensor library for machine learning
#13649 opened May 20, 2025 by wenlujon Loading…
sycl: add find_package call for OpenCL ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13643 opened May 19, 2025 by AD2605 Loading…
sycl: Add more debug prints ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13640 opened May 19, 2025 by Rbiessy Loading…
[CANN]: add the basic supports of Flash Attention kernel Ascend NPU issues specific to Ascend NPUs documentation Improvements or additions to documentation ggml changes relating to the ggml tensor library for machine learning
#13627 opened May 19, 2025 by shibizhao Loading…
cuda: fix CMAKE_CUDA_COMPILER not found error (#13528) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13625 opened May 19, 2025 by lizhenneng Loading…
SYCL: Add non contiguous support in RMS_NORM and NORM kernels ggml changes relating to the ggml tensor library for machine learning SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13611 opened May 18, 2025 by qnixsynapse Loading…
ggml: aarch64: Implement SVE F32 kernels for Mamba Model ggml changes relating to the ggml tensor library for machine learning
#13602 opened May 17, 2025 by vineelabhinav Loading…
ggml : add memset_tensor for rpc ggml changes relating to the ggml tensor library for machine learning
#13601 opened May 17, 2025 by gkpln3 Loading…
ggml : fix race-condition in ggml-rpc ggml changes relating to the ggml tensor library for machine learning
#13600 opened May 17, 2025 by gkpln3 Loading…
Granite Four Apple Metal https://en.wikipedia.org/wiki/Metal_(API) ggml changes relating to the ggml tensor library for machine learning python python script changes testing Everything test related
#13550 opened May 14, 2025 by gabe-l-hart Draft
2 tasks
cuda: set cuda compiler path (#13527) ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13528 opened May 14, 2025 by lizhenneng Loading…
musa: restore MUSA graph settings in CMakeLists.txt ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13382 opened May 8, 2025 by yeahdongcn Draft
llama: Fix typos in multiple files ggml changes relating to the ggml tensor library for machine learning Kompute https://github.com/KomputeProject/kompute/ python python script changes SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
#13369 opened May 8, 2025 by co63oc Loading…
CUDA: update build CTK version to 12.8 devops improvements to build systems and github actions ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs
#13360 opened May 7, 2025 by thevishalagarwal Loading…
add AMD Genoa ggml changes relating to the ggml tensor library for machine learning
#13334 opened May 6, 2025 by QuPengfei Loading…
[Perf] [CPU] eliminate redundant memory access in group query attention ggml changes relating to the ggml tensor library for machine learning
#13319 opened May 5, 2025 by ZelinMa557 Loading…
ProTip! Exclude everything labeled bug with -label:bug.