Description
crawl4ai version
0.5.0.post2
Expected Behavior
I updated Craw4AI to version 0.5.0.post2. I want to setup check using crawl4ai-doctor. Expected to get status healthy. Unfortunate I got error.
─```
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ × Unexpected error in _crawl_web at line 579 in _crawl_web (../chatbot/anaconda3/envs/crawler_2/lib/python3.11/site- │
│ packages/crawl4ai/async_crawler_strategy.py): │
│ Error: Failed on navigating ACS-GOTO: │
│ Page.goto: Timeout 60000ms exceeded. │
│ Call log: │
│ - navigating to "https://crawl4ai.com/", waiting until "domcontentloaded" │
│ │
│ │
│ Code context: │
│ 574 response = await page.goto( │
│ 575 url, wait_until=config.wait_until, timeout=config.page_timeout │
│ 576 ) │
│ 577 redirected_url = page.url │
│ 578 except Error as e: │
│ 579 → raise RuntimeError(f"Failed on navigating ACS-GOTO:\n{str(e)}") │
│ 580 │
│ 581 await self.execute_hook( │
│ 582 "after_goto", page, context=context, url=url, response=response, config=config │
│ 583 ) │
│ 584
### Current Behavior
I got following Error:
(crawler_2) root@gpt2:~# crawl4ai-doctor
[INIT].... → Running Crawl4AI health check...
[INIT].... → Crawl4AI 0.5.0.post2
[TEST].... ℹ Testing crawling capabilities...
[ERROR]... × https://crawl4ai.com... | Error:
┌───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┐
│ × Unexpected error in _crawl_web at line 579 in _crawl_web (../chatbot/anaconda3/envs/crawler_2/lib/python3.11/site- │
│ packages/crawl4ai/async_crawler_strategy.py): │
│ Error: Failed on navigating ACS-GOTO: │
│ Page.goto: Timeout 60000ms exceeded. │
│ Call log: │
│ - navigating to "https://crawl4ai.com/", waiting until "domcontentloaded" │
│ │
│ │
│ Code context: │
│ 574 response = await page.goto( │
│ 575 url, wait_until=config.wait_until, timeout=config.page_timeout │
│ 576 ) │
│ 577 redirected_url = page.url │
│ 578 except Error as e: │
│ 579 → raise RuntimeError(f"Failed on navigating ACS-GOTO:\n{str(e)}") │
│ 580 │
│ 581 await self.execute_hook( │
│ 582 "after_goto", page, context=context, url=url, response=response, config=config │
│ 583 ) │
│ 584 │
└───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────┘
[ERROR]... × ❌ Test failed: Failed to get content
### Is this reproducible?
Yes
### Inputs Causing the Bug
```bash
Steps to Reproduce
Code snippets
OS
ubuntu
Python version
python 3.11
Browser
No response
Browser version
No response
Error logs & Screenshots (if applicable)
No response
Activity