Skip to content

Add Cheaper Inference as a built-in AI provider #11070

Description

@aiapienthusiast

Description

I want to use Cheaper Inference as a built-in AI provider in marimo.
Cheaper Inference is an OpenAI-compatible LLM gateway.
One API key gives access to models from several labs.

The change follows the OpenRouter and OpenCode Go pattern:

  • [ai.cheaperinference] config with api_key and base_url.
  • Default base URL https://api.cheaperinference.com/v1/.
  • Env fallback CHEAPER_INFERENCE_API_KEY.
  • Model prefix cheaperinference/, for example cheaperinference/gpt-5.4-mini.
  • A settings panel entry, an icon, docs, and tests.

Requests go through the marimo server, like other OpenAI-compatible providers.

Are you willing to submit a PR? (You must receive approval from the team before submitting a PR.)

  • Yes

Alternatives

Users can add it under custom_providers with the base URL and key.

Additional context

Docs: https://cheaperinference.com/docs
Models: https://cheaperinference.com/markets

Activity

  1. kirangadhave commented on Oct 2, 2026

    @kirangadhave
    Member

    Hi @aiapienthusiast, you can add cheaper inference as a custom provider with Settings > AI > AI Provider tab:

    Image

    Are you running into issues with this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions