-
Notifications
You must be signed in to change notification settings - Fork 5.8k
Closed
Labels
enhancementNew feature or requestNew feature or request
Description
Description
Please enable, through the CLI or UI, the ability to select different samplers and adjust their parameters when using llama.cpp. In particular, mirostat is showing a lot of promise for improving the quality of text generation.
Additional Context
Here's the pull request on the llama.cpp side: ggml-org/llama.cpp#1126
Fluorax, chrisbennight, weaklysupervised, noprotocolunit, Thireus and 3 more
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request