docs: add support for model providers with usage examples #2866
Conversation
|
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
docs/api/inputs/chat.md
Outdated
| @@ -37,6 +37,88 @@ AI models from popular providers or custom functions. | |||
|
|
|||
| ## Basic Usage | |||
|
|
|||
| ## Supported Model Providers | |||
There was a problem hiding this comment.
can this go at the bottom?
There was a problem hiding this comment.
can this go at the bottom?
Sure, will reposition this.
docs/api/inputs/chat.md
Outdated
| :::: | ||
|
|
||
| ```{note} | ||
| We have added examples for GROQ and Cerebras. These providers offer free API keys and are great for trying out Llama models (from Meta). Cerebras, as of today, offers the fastest inferencing of the Llama3.1 70B model and GROQ is also competitive in this space. |
There was a problem hiding this comment.
I think we can drop Cerebras, as of today,...competitive in this space.
docs/api/inputs/chat.md
Outdated
| chatbot | ||
| ``` | ||
|
|
||
| We recommend using free providers like [GROQ](https://groq.com/) and [Cerebras](https://cerebras.ai/), as you can sign up on their platforms and integrate with various AI integrations in marimo easily. For more information, refer to the [AI completion documentation in marimo](https://docs.marimo.io/guides/editor_features/ai_completion.html#ai-completion). |
There was a problem hiding this comment.
this could be /guides/editor_features/ai_completion#ai-completion
docs/api/inputs/chat.md
Outdated
| chatbot | ||
| ``` | ||
|
|
||
| We recommend using free providers like [GROQ](https://groq.com/) and [Cerebras](https://cerebras.ai/), as you can sign up on their platforms and integrate with various AI integrations in marimo easily. For more information, refer to the [AI completion documentation in marimo](https://docs.marimo.io/guides/editor_features/ai_completion.html#ai-completion). |
There was a problem hiding this comment.
i think you pretty much mention this in the note above. i would either consolidate or remove this one
docs/api/inputs/chat.md
Outdated
|
|
||
| If you want more examples for model providers and their endpoints listed, please submit a [feature request](https://github.com/marimo-team/marimo/issues/new?template=documentation.yaml). | ||
|
|
||
| ### Example Usage |
There was a problem hiding this comment.
i think we can delete these, we already have the same example above
There was a problem hiding this comment.
Ah alright; my reasoning was, the first link above (is for a feature request) to include model providers which can't be run through overriding the base_url -> not openAI compatible; the hyperlink below is for a doc change (.doc.yaml) if people want more model providers to be listed in this chat.md doc webpage (for reference). Can remove it to not be seen as repetitive from the outside (though the hyperlinks are different).
docs/api/inputs/chat.md
Outdated
| ``` | ||
|
|
||
| ::: | ||
| :::: |
There was a problem hiding this comment.
can you add an entry for xai? then we can close out that ticket #2773
model="grok-beta",
base_url="https://api.x.ai/v1",
There was a problem hiding this comment.
Thanks for the info, will do it now. (Didn't do it earlier as I could not test it - don't have an API key as such) and wanted to be sure before having that as a category.
There was a problem hiding this comment.
i pulled this from their docs, i think its ok to not test and assume their docs are accurate in that case
|
🚀 Development release published. You may be able to view the changes at https://marimo.app?v=0.9.19-dev7 |
📝 Summary
Update the
chat.mdfile to include examples for GROQ and Cerebras model providers (while also linking the LiteLLM page to showcase various other model providers).Address comment - #2773 (comment)
🔍 Description of Changes
📋 Checklist
📜 Reviewers
@akshayka OR @mscolnick