🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy
-
Updated
Mar 15, 2025 - Python
🚀 大语言模型高效转发服务 · An efficient forwarding service designed for LLMs. · OpenAI API Reverse Proxy
⚔️Python Rate-Limiter using Leaky-Bucket Algorithm Family
🔧 High-performance Python rate limiting library with multiple algorithms (Fixed Window, Sliding Window, Token Bucket, Leaky Bucket & GCRA) and storage backends (Redis, In-Memory).
🔀⏳ Easy throttling with asyncio support
A FastAPI Framework for things like Database, Redis, Logging, JWT Authentication, Rate Limits and Sessions
Rate limiter for async functions using Redis as a backend.
A lightweight package that provides rate-limited httpx transports.
python decorator that limits the calling rate of a function
For the filthiest web scrapers that have no time for rate-limits.
Automated rate limits implementation for web servers
A fixed window rate limiter based on Redis
Highly configurable resource usage/limit tracker
Easily rate limit async requests to API using credits, computation unit per second (CUPS) or request units, and to those just counting the number of requests per time unit
Simple Multi-Resource Rate Limiting That Saves Unused Tokens. Rate limit API requests across different resources and workers without wasting your quota. Reserve tokens upfront, get refunds for what you don't use, and avoid over-limiting.
Collecting, validating, and caching free proxies, very fast!
Python sliding window counter API rate limiter using Redis.
OpenStack Rate Limit Middleware
A simple asyncio-based rate limiter for python using Redis.
Add a description, image, and links to the rate-limit topic page so that developers can more easily learn about it.
To associate your repository with the rate-limit topic, visit your repo's landing page and select "manage topics."