Fix/model config init #61
Closed
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add async support for all model decoders - Add streaming support for all model decoders - Improve error handling with LiteLLM-specific exceptions - Add exponential backoff for retries - Refactor code for better organization and reusability - Add proper type hints and docstrings
feat: enhance LiteLLM integration with async and streaming support
- Add TOML-based configuration system - Add model factory for creating models from config - Add model and agentless configuration classes - Update model classes to use configuration
- Add model-specific feature support checks - Add all LiteLLM parameters to configuration - Add example configurations for different model types - Add validation and adjustment of parameters based on model capabilities
- Add comprehensive LiteLLM integration guide - Document all configuration options - Add model-specific feature support - Add usage examples and error handling - Update README with LLM integration section
- Convert dataset to list before using with ThreadPoolExecutor - Update iteration to use list instead of dataset directly - Fix potential thread safety issues when accessing dataset items
- Fix ModelConfig initialization in OpenAIChatDecoder and AnthropicChatDecoder - Add explicit parameters instead of **kwargs - Add Qwen model configuration - Remove duplicate tools definition
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.