Select llm model from list #331
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Added a button *Default* to each config value in the UI that resets it to the default value
- Added `{player_description}`, `{player_equipment}`, `{equipment}` and `{weather}` to Skyrim default prompts
- moved prompt config values into their own category to unclutter LLM category
- Selection config values can now be set to also allow free text input
- Default values of String config values are now stripped of whitespaces at the beginning and end of each line
- fixed merge bug that left `Character.equipment` property without the `@property` tag
- modifies LLM config values `llm_api` and `model` - `llm_api` now is dropdown with optional manual input. Options: OpenRouter, OpenAi, KoboldCpp, Textgenwebui. - `model` now comes with an extra button *Update list* that updates the list of available models with the ones requested from OpenRouter or Open AI - added function to determine available models to `openai_client.py` - cleaned up `settings_ui_constructor.py` - moved `automatic_greeting` from *LLM* to *Other* category
art-from-the-machine
approved these changes
Aug 7, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
based on #330
llm_apiandmodelllm_apinow is a dropdown with optional manual input. Options: OpenRouter, OpenAi, KoboldCpp, Textgenwebui.modelnow comes with an extra button Update list that updates the list of available models with the ones requested from OpenRouter or Open AIopenai_client.pysettings_ui_constructor.pyautomatic_greetingfrom LLM to Other category@art-from-the-machine
As I don't have access to OpenAI you would need to double check if the code to retrieve the list from OpenRouter works the same for OpenAI. Requesting the models should be the same, as is the name/id of them. I suspect the information about context and pricing could be located somewhere else in the result object or maybe even missing entirely.