#

agentic-web-crawler

Here is 1 public repository matching this topic...

aaronlifton / fastcrawl

an agentic atomics-based low-heap allocation web crawler written in Rust, that can crawl Wikipedia at a rate of ~75 pages/sec.

rust wikipedia web-crawler streaming-parser ai-agents atomics stack-allocation agentic-framework agentic-ai agentic-web-crawler

Updated Nov 16, 2025
Rust

Improve this page

Add a description, image, and links to the agentic-web-crawler topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the agentic-web-crawler topic, visit your repo's landing page and select "manage topics."