Open
Description
openedon Apr 7, 2022
Based on a request in turbot/steampipe-plugin-aws#687 and other feedback from users around plugin throttling, I think it would be useful if in the connection options, we could tune concurrency for API calls for listing resources, hydrates, and other types.
Limiting the maximum number of API calls by a static number, by time (per second?), and potentially other dimensions would be helpful.
This would allow users to increase or slow down the speed at which each connections attempts to get all of the data. The decrease is particularly helpful for services that have strict/low request limits.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment