Add LoRAX to usage options

NetEase-FuXi · Jan 27, 2024 · 3da5b49 · 3da5b49
1 parent 71adb5e
commit 3da5b49
Showing 1 changed file with 5 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -76,6 +76,11 @@ see [this](https://github.com/huggingface/text-generation-inference/pull/1018)
 --quantize eetq
 ```
 
+4. Use EETQ in [LoRAX](https://github.com/predibase/lorax). See [docs](https://predibase.github.io/lorax/guides/quantization/#eetq) here.
+```bash
+lorax-launcher --model-id mistralai/Mistral-7B-v0.1 --quantize eetq ...
+```
+
 ## Examples
 
 Model: