Skip to content

Commit 97c5f4e

Browse files
committed
chore(model): add l3.1-8b-slush-i1 to the gallery
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent b7d7571 commit 97c5f4e

File tree

1 file changed

+17
-0
lines changed

1 file changed

+17
-0
lines changed

gallery/index.yaml

Lines changed: 17 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2736,6 +2736,23 @@
27362736
- filename: Llama-3.1-8B-ArliAI-RPMax-v1.3-Q4_K_M.gguf
27372737
sha256: 66fcbbe96950cc3424cba866f929180d83f1bffdb0d4eedfa9b1f55cf0ea5c26
27382738
uri: huggingface://bartowski/Llama-3.1-8B-ArliAI-RPMax-v1.3-GGUF/Llama-3.1-8B-ArliAI-RPMax-v1.3-Q4_K_M.gguf
2739+
- !!merge <<: *llama31
2740+
name: "l3.1-8b-slush-i1"
2741+
icon: https://huggingface.co/crestf411/L3.1-8B-Slush/resolve/main/slush.jpg?
2742+
urls:
2743+
- https://huggingface.co/crestf411/L3.1-8B-Slush
2744+
- https://huggingface.co/mradermacher/L3.1-8B-Slush-i1-GGUF
2745+
description: |
2746+
Slush is a two-stage model trained with high LoRA dropout, where stage 1 is a pretraining continuation on the base model, aimed at boosting the model's creativity and writing capabilities. This is then merged into the instruction tune model, and stage 2 is a fine tuning step on top of this to further enhance its roleplaying capabilities and/or to repair any damage caused in the stage 1 merge.
2747+
This is an initial experiment done on the at-this-point-infamous Llama 3.1 8B model, in an attempt to retain its smartness while addressing its abysmal lack of imagination/creativity. As always, feedback is welcome, and begone if you demand perfection.
2748+
The second stage, like the Sunfall series, follows the Silly Tavern preset, so ymmv in particular if you use some other tool and/or preset.
2749+
overrides:
2750+
parameters:
2751+
model: L3.1-8B-Slush.i1-Q4_K_M.gguf
2752+
files:
2753+
- filename: L3.1-8B-Slush.i1-Q4_K_M.gguf
2754+
sha256: 98c53cd1ec0e2b00400c5968cd076a589d0c889bca13ec52abfe4456cfa039be
2755+
uri: huggingface://mradermacher/L3.1-8B-Slush-i1-GGUF/L3.1-8B-Slush.i1-Q4_K_M.gguf
27392756
- &deepseek
27402757
## Deepseek
27412758
url: "github:mudler/LocalAI/gallery/deepseek.yaml@master"

0 commit comments

Comments
 (0)