#
prox
Here are 2 public repositories matching this topic...
π Cache-cool: A fast, flexible LLM caching proxy that reduces latency and API costs by caching repetitive calls to LLM services. π Supports dynamic configurations, π multiple backends (π₯ Redis, π’ MongoDB, π JSON), and ποΈ schema-specific settings.
-
Updated
Sep 1, 2024 - Python
Improve this page
Add a description, image, and links to the prox topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the prox topic, visit your repo's landing page and select "manage topics."