litellm-alternative

AI gateway / AI control plane / AI proxy written in Go. Unified OpenAI-compatible and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, vLLM and more. A LiteLLM alternative with observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs and usage tracking. Prod ready.

Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Point your existing SDK at one URL and reach every LLM vendor — with real failover, not a try/except. One static Rust binary.

A self-hosted, OpenAI-compatible LLM gateway with multi-provider failover, key rotation, and a built-in admin console.

The Fastest enterprise AI gateway — route LLM traffic across OpenAI, Anthropic, Gemini, Groq & 30+ providers via a single API. Self-hosted, no vendor lock-in. ( 55x faster than litellm )

A lightweight, highly secure AI API Gateway/Proxy written in Go. Acts as transparent middleware between local AI coding clients (OpenCode/Pi/Cursor) and upstream LLM providers (Gemini, DeepSeek, Zhipu z.ai).

Local-first AI gateway with bidirectional protocol conversion (Anthropic ↔ OpenAI ↔ Responses). Route Claude Code / Codex CLI to any provider by quality tag, with failover. Rust + Tauri.

Lightweight, provider-agnostic Python LLM library — one API for OpenAI, Gemini, Anthropic, Groq, Mistral, Cohere, Azure, Bedrock & Ollama. Vision, streaming, tools, batch.

Production LLM calls. Just the three lines. Cross-provider fallback, native caching, and reversible context compression on by default.

Open WebUI starter for connecting to a unified OpenAI-compatible model gateway.

Connect OpenCode to local LLM servers like Ollama, vLLM, and LM Studio using one provider with automatic runtime model detection.

Command-line tool / Terminal User Interface to install and manage Nenya AI Gateway.

Single-binary OpenAI-compatible inference proxy: API key GUI, exact usage metering, full request logging, OTel GenAI export

The LLM gateway that never hands your task to a model that can't handle it. BYOK free-tier pooling, key rotation, failover — and quality-verified routing with receipts. MIT, self-hosted.

Self-hosted AI gateway in Go: pool Claude/ChatGPT/Gemini subscription accounts behind one OpenAI-compatible endpoint, with virtual keys, budgets, built-in token savers and an MCP gateway. A single-binary LiteLLM alternative.

Self-hosted multi-model gateway for Claude Code: cut your Claude bill by fanning cheap-model swarms, with session-pinned prompt-cache locality.

Gateway-agnostic control plane for LLMs — an OpenAI-compatible governance proxy (auth, guardrails, budgets, routing, cost, observability) over a swappable engine: Bifrost / LiteLLM / Portkey / Direct. Own the control plane, swap the translator.

A Custom LiteLLM proxy + UI Docker Compose stack (Postgres + Valkey), bind-mounted config and data for host-editable persistence.

AI gateway that fixes Gemini thought_signature errors, cuts token costs ~70% by stripping reasoning history, rotates API keys atomically via Redis Lua, and provides sticky model failover chains — all in sub-ms Bun/TypeScript.

Thin, memory-bounded OpenAI/Anthropic-compatible LLM reverse proxy in Rust — transparent streaming passthrough with bounded usage/cost/rate-limit observability, opt-out optimizations, and a multi-instance dashboard.