Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy

NyaProxy acts like a smart, central manager for accessing various online services (APIs) – think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.

LLM router + minimal agent framework in one. Call any LLM API with OpenAI format. Unified billing, tools, retries, fallback, logging. Build agents and AI apps in pure Python. Full control. Zero magic.

最简单的方式实现自建主机搭建的OpenAI api(Chatgpt api)代理。

Aqueduct is a simple yet fully-featured AI gateway built on top of the LiteLLM Router SDK using Django.

Lightweight AI inference gateway - local model registry & parameter transformer (Python SDK) - with optional Envoy proxy processor and FastAPI registry server deployment options.

An OpenAI API proxy running with Cloudflare worker.

A minimal FastAPI proxy for OpenAI’s Chat Completions and Embeddings APIs. Supports wrapper API keys that map to real OpenAI API keys, enabling multi-tenant usage, simple key management, and full compatibility with the official OpenAI Python SDK.

A proxy for interacting with multiple LLMs through a user-transparent OpenAI request

🌐 Route API requests through your residential IP to bypass restrictions on cloud IPs for services like Reddit and enhance functionality with Claude Skills.

An openai proxy powered by cloudflare python workers

NyaProxy acts like a smart, central manager for accessing various online services (APIs) - think AI tools (like OpenAI, Gemini, Anthropic), image generators, or almost any web service that uses access keys. It helps you use these services more reliably, efficiently, and securely.

The Self-Hosted AI Firewall & Gateway. Drop-in guardrails for LLMs running entirely on CPU. Blocks jailbreaks, enforces policies, and ensures compliance in real-time