Skip to content

Issues: mistralai/mistral-inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
119 Open 28 Closed
119 Open 28 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[BUG: ImportError: cannot import name 'Transformer' from 'mistral_inference.model' (/usr/local/lib/python3.10/dist-packages/mistral_inference/model.py) bug Something isn't working
#206 opened Jul 26, 2024 by rabeeqasem
9
[BUG: Could not find consolidated.00.pth or consolidated.safetensors in Mistral model path but mistralai/Mistral-Large-Instruct-2407 surely not contains it bug Something isn't working
#205 opened Jul 26, 2024 by ShadowTeamCN
9
[BUG: AssertionError: Mamba is not installed. Please install it using pip install mamba-ssm. bug Something isn't working
#192 opened Jul 17, 2024 by matbee-eth
9
Has any thought been given to using LoRA to increase the number of experts (100x) with minimal memory?
#95 opened Dec 22, 2023 by sixChar
8
[BUG: ModuleNotFoundError: No module named 'mistral_inference.transformer' ​ bug Something isn't working
#202 opened Jul 23, 2024 by yafangwang9
6
How to use a prompt for text analysis?
#145 opened Apr 15, 2024 by rsoika
6
Embedding model and Engine??
#62 opened Oct 31, 2023 by muhtalhakhan
6
More language support?
#61 opened Oct 31, 2023 by OnceJune
6
Xformers cannot be installed on MAC M1 Pro
#7 opened Sep 28, 2023 by Naqqash
6
[BUG] Transformer.from_folder() does not load the model on multiple GPU bug Something isn't working
#197 opened Jul 19, 2024 by Cerrix
4
I am unable to build the vLLM Container
#142 opened Mar 27, 2024 by AMGI-Pipeline
4
Installation Problem
#124 opened Feb 12, 2024 by jahbini
4
model is giving answer in russian
#66 opened Nov 5, 2023 by Sanchit-404
4
Mistral-7B-instruct-v0.1 compatibility with main.py
#30 opened Oct 3, 2023 by nvidal01
4
Missing model card / data sheet with info on pretraining and RLHF datasets
#9 opened Sep 28, 2023 by mdingemanse
4
[BUG: pip install mistral_inference: ModuleNotFoundError: No module named 'torch' bug Something isn't working
#228 opened Oct 4, 2024 by chrisstankevitz
3
!mistral-demo $7B_DIR issue
#154 opened May 22, 2024 by shaimaa0000
3
JSON response format failing to retrieve clean JSON
#146 opened Apr 17, 2024 by serferdinand2
3
Fine Tuning Mistral 7b
#141 opened Mar 21, 2024 by nourolive
3
Missing the params.json
#140 opened Mar 19, 2024 by littlewwwhite
3
[Mistral 7B mistral-7b-instruct-v0.1.Q8_0.gguf] Wrong text "quoted" while presented as real
#131 opened Mar 3, 2024 by SINAPSA-IC
3
Code complete?
#57 opened Oct 28, 2023 by zhoumengbo
3
Python 3.11.6 compatibility
#45 opened Oct 15, 2023 by MasterLivens
3
Error on interactive run
#14 opened Sep 28, 2023 by sreekarchigurupati
3
Tokenizer skips the special tokens while decoding
#162 opened May 27, 2024 by anandsarth
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.