List of libraries, tools and APIs for web scraping and data processing.
SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.
📱 A utility for downloading Android apps from the Google Play Store and Xiaomi App Store (the Chinese App Store).
🚀 OFFICIAL STARTER TEMPLATE FOR BOTASAURUS SCRAPING FRAMEWORK 🤖
An declarative and easy to use web crawler and scraper in C#
Web crawling & scraping framework for Node.js on top of headless Chrome browser
🕷️ Easily scrap the web for torrent and media files.
AI Scraper : scrap and extract data from website in any format (CSV, JSON, HTML...) using Selenium or Crawl4ai, and using Ollama or Sambanova API, and using Streamlit for UI as chatbot
Firetastic - a tool for automating interaction with FireTV apps
🚀 THIS WEB SCRAPING TEMPLATE PROVIDES YOU WITH A GREAT STARTING POINT WHEN CREATING WEB SCRAPING BOTS. 🤖
List of best web crawlers to extract data from the web. Find web crawling tools for different needs.
A Website Spider/Crawler, Python 3.x
This python script crawls course title, ratings, description and instructors from coursera.org
A web Crowler design , basic setup c++
Recon Crawling Endpoint and Parameter Scan Tool
Firetastic - a tool for automating interaction with FireTV apps
By scraping leads from Google Maps, you can build a database of potential customers who have shown interest in products or services related to your business. This data can be used for targeted marketing campaigns, email outreach, or sales prospecting.
A spam spider which is targeting 'Untitled' spam pages from the Google search results.
The DirFinder tool is user for bruteforce directory with dedicated Wordlist is very simple user-friendly to use
Add a description, image, and links to the crawling-tool topic page so that developers can more easily learn about it.
To associate your repository with the crawling-tool topic, visit your repo's landing page and select "manage topics."