Skip to content

Commit

Permalink
docs(conceptual/speculation): available links Train Medusa
Browse files Browse the repository at this point in the history
  • Loading branch information
guspan-tanadi authored Dec 23, 2024
1 parent 23bc38b commit ab0b559
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/conceptual/speculation.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ You can check a few existing fine-tunes for popular models:
- [text-generation-inference/Mistral-7B-Instruct-v0.2-medusa](https://huggingface.co/text-generation-inference/Mistral-7B-Instruct-v0.2-medusa)


In order to create your own medusa heads for your own finetune, you should check own the original medusa repo. [../basic_tutorials/train_medusa.md](../basic_tutorials/train_medusa.md)
In order to create your own medusa heads for your own finetune, you should check own the original medusa repo. Read for more in [Train Medusa](../basic_tutorials/train_medusa#training).


In order to use medusa models in TGI, simply point to a medusa enabled model, and everything will load automatically.
Expand Down

0 comments on commit ab0b559

Please sign in to comment.