Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
-
Updated
May 6, 2026 - Rust
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
An ergonomic Rust HTTP Client with TLS fingerprint
Fast, lightweight Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/v1/scrape, /v1/crawl, /v1/search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Common utilities for wreq
Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.
Next-gen AI scraper — LLM-powered structured data extraction
A Rust api that interfaces with the ERP Aurion used by the ISEN
A multi thread application to scrape data from curiositadalmondo.it
A small crate to simplify tab downloading (scraping) in Rust.
A modern, high-performance wget implementation in Rust with async downloads, website mirroring, progress tracking, and rate limiting.
Eclipse Claw — высокопроизводительный веб-парсер на Rust | CLI + API + параллельная обработка
Fast CLI tool to create static copies of websites. Archive client sites before CMS-to-Astro migrations.
Uma ferramenta CLI/TUI moderna escrita em Rust para visualizar o cardápio dos Restaurantes Universitários (RU) da USP.
What happens when you keep following the first link in Wikipedia articles? You almost always get back to the articles on Existence or Awareness
Adaptive web scraping, built in Rust. A high-performance port of Python Scrapling.
Scraper to get Mahjong Soul stickers from an HTML fragment
Recursively crawls and scrapes a Blogger site to archive post content
Web scraper for Phantom of the Night Genshin Impact web event
Add a description, image, and links to the web-scraper topic page so that developers can more easily learn about it.
To associate your repository with the web-scraper topic, visit your repo's landing page and select "manage topics."