Open
Description
Field | Description |
---|---|
Plugin | llm |
Nixpkgs | unstable |
Home Manager | unstable |
- I have read the FAQ and my bug is not listed there.
Description
On the settings-options.nix of the llm plugin it is defined the tokenizer option that may be one of three defined submodules (or it may be raw), however when specifying the values of any submodule with exception of the localFile
one, the options are not recognized and an error is shown.
It may be related to the example.path
attribute.
Minimal, Reproducible Example (MRE)
programs.nixvim.plugins.llm = {
enable = true;
settings = {
model = "bigcode/starcoder2-15b";
backend = "huggingface";
# This fails
tokenizer = {
url = "https://my-endpoint.example.com/mytokenizer.json";
to = "/download/path/of/mytokenizer.json";
};
# This also fails
# tokenizer = {
# repository = "codellama/CodeLlama-7b-hf";
# api_token = "1234567890";
# };
};
}