feat(models): add openai oss models#880
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
1 Skipped Deployment
|
There was a problem hiding this comment.
Greptile Summary
This PR updates the Groq provider configuration in apps/sim/providers/models.ts to include OpenAI OSS (open source) models and other models available through Groq's inference platform. The changes reflect Groq's expansion from hosting only their proprietary models to providing fast inference for a broader catalog of open-source models.
Key changes include:
- Updated the default model from
groq/meta-llama/llama-4-scout-17b-16e-instructtoopenai/gpt-oss-120b - Added new OpenAI OSS models with
openai/prefixes (openai/gpt-oss-120b,openai/gpt-oss-20b) - Updated existing models to remove
groq/prefixes (e.g.,gemma2-9b-it,llama-3.1-8b-instant) - Enhanced most models with
toolUsageControl: true, indicating improved function calling capabilities - Updated pricing across all models with a consistent date of '2025-08-05'
This change integrates with the existing provider system where modelPatterns are used for routing model requests to the appropriate inference provider. The Groq provider now serves as a gateway to multiple model families while maintaining its reputation for fast inference speeds.
Confidence score: 1/5
- This PR has a critical configuration bug that will break model routing for most of the newly added models
- Score reflects a fundamental mismatch between model IDs and the pattern matching system used for provider detection
- Pay close attention to the
modelPatternsconfiguration on lines 450-451 and how it conflicts with the new model naming scheme
1 file reviewed, 1 comment
696e157 to
4d6b82a
Compare
4d6b82a to
9291d9d
Compare
9291d9d to
18cbfcd
Compare
* feat(models): add openai oss models * fix tool usage control for groq
* feat(models): add openai oss models * fix tool usage control for groq
Summary
add openai oss models for groq
Type of Change
Testing
Tested manually
Checklist
Screenshots/Videos
Screen.Recording.2025-08-05.at.11.39.59.AM.mov