AI-native (edge and LLM) proxy for agents. Engineered with fast ⚡️ LLMs for task routing, rich observability, and the seamless integration of prompts with your APIs for agentic tasks. Built by the contributors of Envoy proxy.
proxy routing gateway prompt proxy-server openai envoy envoyproxy llms generative-ai llmops llm-inference ai-gateway llm-gateway llm-routing
-
Updated
Feb 1, 2025 - Rust