#

prox

Here are 2 public repositories matching this topic...

MSNP1381 / cache-cool

🌟 Cache-cool: A fast, flexible LLM caching proxy that reduces latency and API costs by caching repetitive calls to LLM services. 🔄 Supports dynamic configurations, 📚 multiple backends (🟥 Redis, 🟢 MongoDB, 📁 JSON), and 🏗️ schema-specific settings.

caching prox fastapi llm

Updated Sep 1, 2024
Python

mozilla-mobile / prox-server

[INACTIVE] Server & data scripts for the Prox client.

mozilla prox nmx

Updated Mar 9, 2017
Python

Improve this page

Add a description, image, and links to the prox topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the prox topic, visit your repo's landing page and select "manage topics."