Open
Description
Brief Description
Add support for using Groq as an LLM
Rationale
Groq has an OpenAI-compatible API that allows you to call Mixtral LLM generation on their specialized hardware known as LPUs (Language Processing Units) to get high quality output at 4x the speed of GPT 3.5.
Suggested Implementation
Create a new LLM
Metadata
Assignees
Labels
No labels