Skip to content

get response body for cdp network #278

@SpaceX-RM

Description

@SpaceX-RM

When I try to run this code:

/////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

from botasaurus.browser import browser, Driver, cdp
@browser()
def scrape_responses_task(driver: Driver, data):
def after_response_handler(
request_id: str,
response: cdp.network.Response,
event: cdp.network.ResponseReceived,
):
url = response.url
status = response.status
headers = response.headers
print(
"after_response_handler",
{
"request_id": request_id,
"url": url,
"status": status,
"headers": headers,
},
)
driver.responses.append(request_id)

driver.after_response_received(after_response_handler)
driver.get("https://example.com/")
collected_responses = driver.responses.collect()

return collected_responses

scrape_responses_task()

#/////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

I get this error:

***********************************************************************************************************************************

Traceback (most recent call last):
File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus\browser_decorator.py", line 201, in run_task
result = func(driver, data)
File "c:\Users\hp\Desktop\Scripts\hdfc copy 3.py", line 37, in scrape_responses_task
collected_responses = driver.responses.collect()
File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 2050, in collect
return self.driver.collect_responses(self)
File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 853, in collect_responses
return [self.collect_response(request_id) for request_id in request_ids]
File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 853, in
return [self.collect_response(request_id) for request_id in request_ids]
File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 850, in collect_response
return response
UnboundLocalError: local variable 'response' referenced before assignment
Task failed for input: None
View screenshot at C:\Users\hp\Desktop\Scripts\error_logs\2025-09-08_16-46-29\screenshot.png
We've paused the browser to help you debug. Press 'Enter' to close.

********************************************************************************************************************************

Knowing that I have implemented this matter as well:

python -m pip install bota botasaurus botasaurus-api botasaurus-requests botasaurus-driver bota botasaurus-proxy-authentication botasaurus-server --upgrade

........
I hope for a solution because I need this method a lot

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions