Skip to content

Add max retry parameter to the execution prevent HTTP 429 #802

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
ianhelle merged 3 commits into from
Oct 21, 2024
Merged

Add max retry parameter to the execution prevent HTTP 429 #802

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
49c07b6
Add max retry parameter to the execution
Oct 18, 2024
f994e75
Merge branch 'main' into cybereason-driver-fix-http429
ianhelle Oct 21, 2024
1c34e06
Merge branch 'main' into cybereason-driver-fix-http429
ianhelle Oct 21, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 4 additions & 1 deletion msticpy/data/drivers/cybereason_driver.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -401,6 +401,7 @@ def __execute_query(
page: int = 0,
page_size: int = 2000,
pagination_token: str = None,
max_retry: int = 3,
) -> Dict[str, Any]:
"""
Run query with pagination enabled.
Expand Down Expand Up @@ -436,7 +437,8 @@ def __execute_query(
headers = {}
params = {"page": page, "itemsPerPage": page_size}
status = None
while status != "SUCCESS":
cur_try = 0
while status != "SUCCESS" and cur_try < max_retry:
response = self.client.post(
self.search_endpoint,
json={**body, **pagination},
Expand All @@ -446,6 +448,7 @@ def __execute_query(
response.raise_for_status()
json_result = response.json()
status = json_result["status"]
cur_try += 1
return json_result

async def __run_threaded_queries(
Expand Down