Skip to content

Conversation

@gregnr
Copy link
Collaborator

@gregnr gregnr commented Aug 16, 2024

Problem

As with any free product, most users use it as intended, but a small number take advantage and abuse it.

Solution

This update introduces standard rate limiting to the app. Current limits are:

  • Input tokens: 1000000/30m
  • Output tokens: 10000/30m

After reaching this limit the user will see:
image

Until the next reset period.

@gregnr gregnr merged commit 24a181d into main Aug 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants