Skip to content

Commit 31d73eb

Browse files
authored
chore(model gallery): add mistralai_magistral-small-2506 (#5629)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 60863b9 commit 31d73eb

File tree

1 file changed

+25
-0
lines changed

1 file changed

+25
-0
lines changed

gallery/index.yaml

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12464,6 +12464,31 @@
1246412464
- filename: MS-24B-Mullein-v0.Q4_K_M.gguf
1246512465
sha256: ef30561f1f7a9057b58e6f1b7c8a5da461bb320216232edf3916c1c02cb50e34
1246612466
uri: huggingface://mradermacher/MS-24B-Mullein-v0-GGUF/MS-24B-Mullein-v0.Q4_K_M.gguf
12467+
- !!merge <<: *mistral03
12468+
name: "mistralai_magistral-small-2506"
12469+
icon: https://cdn-avatars.huggingface.co/v1/production/uploads/634c17653d11eaedd88b314d/9OgyfKstSZtbmsmuG8MbU.png
12470+
urls:
12471+
- https://huggingface.co/mistralai/Magistral-Small-2506
12472+
- https://huggingface.co/bartowski/mistralai_Magistral-Small-2506-GGUF
12473+
description: |
12474+
Building upon Mistral Small 3.1 (2503), with added reasoning capabilities, undergoing SFT from Magistral Medium traces and RL on top, it's a small, efficient reasoning model with 24B parameters.
12475+
12476+
Magistral Small can be deployed locally, fitting within a single RTX 4090 or a 32GB RAM MacBook once quantized.
12477+
12478+
Learn more about Magistral in our blog post.
12479+
Key Features
12480+
12481+
Reasoning: Capable of long chains of reasoning traces before providing an answer.
12482+
Multilingual: Supports dozens of languages, including English, French, German, Greek, Hindi, Indonesian, Italian, Japanese, Korean, Malay, Nepali, Polish, Portuguese, Romanian, Russian, Serbian, Spanish, Swedish, Turkish, Ukrainian, Vietnamese, Arabic, Bengali, Chinese, and Farsi.
12483+
Apache 2.0 License: Open license allowing usage and modification for both commercial and non-commercial purposes.
12484+
Context Window: A 128k context window, but performance might degrade past 40k. Hence we recommend setting the maximum model length to 40k.
12485+
overrides:
12486+
parameters:
12487+
model: mistralai_Magistral-Small-2506-Q4_K_M.gguf
12488+
files:
12489+
- filename: mistralai_Magistral-Small-2506-Q4_K_M.gguf
12490+
sha256: b681b81ba30238b7654db77b4b3afa7b0f6226c84d8bbd5a5dfb1a5a3cb95816
12491+
uri: huggingface://bartowski/mistralai_Magistral-Small-2506-GGUF/mistralai_Magistral-Small-2506-Q4_K_M.gguf
1246712492
- &mudler
1246812493
url: "github:mudler/LocalAI/gallery/mudler.yaml@master" ### START mudler's LocalAI specific-models
1246912494
name: "LocalAI-llama3-8b-function-call-v0.2"

0 commit comments

Comments
 (0)