Production LLM call layer for AI agents and tools: keep OpenAI/Anthropic/AI SDK/LiteLLM, hot-swap models with MDA presets, and add cache, retries, circuit breakers, key rotation, singleflight, and Python/TypeScript/Rust parity.
python rust redis typescript gemini openai circuit-breaker sno ai-agents key-rotation ai-sdk ai-tools model-switching llm llmops anthropic litellm llm-cache llm-orchestration sno-ai
-
Updated
Sep 19, 2026 - Python