Skip to content

llama.cpp sampler selection #1764

@nsvrana

Description

@nsvrana

Description

Please enable, through the CLI or UI, the ability to select different samplers and adjust their parameters when using llama.cpp. In particular, mirostat is showing a lot of promise for improving the quality of text generation.

Additional Context

Here's the pull request on the llama.cpp side: ggml-org/llama.cpp#1126

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions