Skip to content

Tokenizer option error in llm plugin #3330

Open
@EmanuelM153

Description

@EmanuelM153
Field Description
Plugin llm
Nixpkgs unstable
Home Manager unstable
  • I have read the FAQ and my bug is not listed there.

Description

On the settings-options.nix of the llm plugin it is defined the tokenizer option that may be one of three defined submodules (or it may be raw), however when specifying the values of any submodule with exception of the localFile one, the options are not recognized and an error is shown.

It may be related to the example.path attribute.

Minimal, Reproducible Example (MRE)

programs.nixvim.plugins.llm = {
  enable = true;
  settings = {
    model = "bigcode/starcoder2-15b";
    backend = "huggingface";

    # This fails
    tokenizer = {
      url = "https://my-endpoint.example.com/mytokenizer.json";
      to = "/download/path/of/mytokenizer.json";
    };

    # This also fails
    # tokenizer = {
    #   repository = "codellama/CodeLlama-7b-hf";
    #   api_token = "1234567890";
    # };
  };
}

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions