Skip to content

Issues: abetlen/llama-cpp-python

Roadmap for v0.2
#487 opened Jul 18, 2023 by abetlen
Open 1
Add batched inference
#771 opened Sep 30, 2023 by abetlen
Open 37
Improve installation process
#1178 opened Feb 12, 2024 by abetlen
Open 8
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
46 Open 78 Closed
46 Open 78 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

No matter how many times I build it, it won't start bug Something isn't working build
#1719 opened Aug 31, 2024 by Enchante503
3 of 4 tasks
1
flash attention on Nvidia Tesla P100s results in the CUDA error: unspecified launch failure - (CUDA kernel flash_attn_tile_ext_f16 has no device code compatible with CUDA arch 520) bug Something isn't working build
#1710 opened Aug 26, 2024 by AlHering
4 tasks done
2
Intel openAPI (openMKL) CMAKE_ARGS enabled? bug Something isn't working build
#1133 opened Jan 26, 2024 by emulated24
5
ERROR: Can't install llama-cpp-python[server] WITH CMAKE_ARGS="-DLLAMA_CUBLAS=on" In VERSION 0.2.24 or higher bug Something isn't working build
#1126 opened Jan 24, 2024 by victordonat0
4 tasks done
12
ERROR: Failed building wheel for llama-cpp-python bug Something isn't working build
#1125 opened Jan 24, 2024 by rishabhgupta93
9
cmake build error: identifier "half" is undefined with version 0.2.29 bug Something isn't working build
#1100 opened Jan 18, 2024 by jannikmi
4 tasks done
2
Issue in installing llama-cpp-python. bug Something isn't working build
#1081 opened Jan 12, 2024 by couragelfyang
6
2.27 and below Cannot Build or Install llama_cpp_python on AMD ROCm HIP POP OS 22.04 CMake Build Failed bug Something isn't working build
#1066 opened Jan 5, 2024 by ganakee
7
windows 11 install faild bug Something isn't working build
#1063 opened Jan 4, 2024 by summerghw
6
Llama-cpp-python installation issues on MacOS with M2 bug Something isn't working build
#956 opened Nov 29, 2023 by erlebach
5
Different gpu buffer behavior using llama-cpp-python[server] vs llama-cpp bug Something isn't working build
#948 opened Nov 25, 2023 by zestysoft
4 tasks done
pip install fails on Windows 10 with conda installation of CLBlast; C++ Standard Library forbids macroizing the keyword "bool" bug Something isn't working build
#945 opened Nov 25, 2023 by jreves
4
0.18 (and others?) no longer use GPU at all bug Something isn't working build
#912 opened Nov 15, 2023 by pseudotensor
4
Module import doesn't work when using pip install llama-cpp-python --target="dir" bug Something isn't working build
#907 opened Nov 13, 2023 by Pathos14489
1
LinkOutsideDestinationError when installing PrivateGPT bug Something isn't working build
#905 opened Nov 13, 2023 by wits-zach
4 tasks done
6
CMAKE config for Ninja unsuitable for compiling on Ryzen 5 6 core cpu bug Something isn't working build
#895 opened Nov 9, 2023 by housebyte
1
Unable to install llama-cpp-python Package in Python - Wheel Building Process gets Stuck bug Something isn't working build documentation Improvements or additions to documentation
#853 opened Oct 30, 2023 by Illanser
5
(mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64')) on M2 bug Something isn't working build documentation Improvements or additions to documentation
#847 opened Oct 27, 2023 by alessandropaticchio
19
Windows: CMake build failed building wheel bug Something isn't working build
#785 opened Oct 3, 2023 by dbookstaber
llama-cpp-python not using GPU on m1 bug Something isn't working build
#756 opened Sep 26, 2023 by agunapal
4 tasks done
28
Crash on x86 with llama-cpp-python with docker or on host directly bug Something isn't working build
#753 opened Sep 26, 2023 by chenqiny
4 tasks done
3
CMake Error at CMakeLists.txt:3 (project) bug Something isn't working build
#751 opened Sep 25, 2023 by hectordanielc
CMake Error: CMAKE_C_COMPILER not set bug Something isn't working build
#749 opened Sep 24, 2023 by Orlandox683
3
FileNotFoundError: Shared library with base name 'llama' not found #MACOS bug Something isn't working build
#739 opened Sep 20, 2023 by Showwwwwwwww
7
Fail to install llama-cpp-python bug Something isn't working build
#738 opened Sep 19, 2023 by serendipitYang
6
ProTip! Add no:assignee to see everything that’s not assigned.