Skip to content
This repository was archived by the owner on Jun 24, 2024. It is now read-only.

Issues: rustformers/llm

Does it support the new GGMLv3 quantization methods?
#286 opened May 29, 2023 by Exotik850
Open 5
Support GGUF
#365 opened Jul 10, 2023 by philpax
Open 4
Clear current search query, filters, and sorts
3 Open 1 Closed
3 Open 1 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Free tensors from RAM if they are offloaded to an Accelerator issue:enhancement New feature or request topic:clblast https://github.com/CNugteren/CLBlast support topic:cublas https://developer.nvidia.com/cublas support topic:metal https://developer.apple.com/metal/ support
#390 opened Jul 27, 2023 by LLukas22
Runtime GPU backend selection issue:enhancement New feature or request topic:api-design API design considerations, including new functionality and changes topic:clblast https://github.com/CNugteren/CLBlast support topic:cublas https://developer.nvidia.com/cublas support topic:metal https://developer.apple.com/metal/ support
#386 opened Jul 23, 2023 by philpax
4
Multi-GPU support for inferencing issue:enhancement New feature or request topic:clblast https://github.com/CNugteren/CLBlast support topic:cublas https://developer.nvidia.com/cublas support
#371 opened Jul 16, 2023 by philpax
1
ProTip! no:milestone will show everything without a milestone.