Skip to content

QLangstaff/qrawl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

66 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Qrawl

Composable web crawling tools for Rust

Install

cargo add qrawl

Tools

  • batch: Batch operations concurrently
  • clean: Clean raw data
  • extract: Extract structured data
  • fetch: Fetch with auto or fast strategy
  • map: Map URLs
  • scrape: Scrape raw data

Templates

License

MIT