website-scraper

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and analysis with Vanta's advanced capabilities. Fast, reliable, and user-friendly, Uscrapper Vanta is the ultimate choice for researchers and analysts.

DPULSE - Tool for complex approach to domain OSINT

Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to return natural language answers to the user's queries.

XML sitemap parser designed to extract and process millions of URLs while bypassing most modern anti-bot protections. Supports plain and compressed XML, unlimited nested sitemaps, multi-threading, multiple inputs, CloudScraper integration, fingerprint randomization, proxy/user agent rotation, auto stealth mode, and detailed monitoring.

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

JSON collection of scraped file extensions, along with their description and type, from FileInfo.com

Website Email Scraper to extract emails, phone numbers, social profiles & tech stack from any site into structured JSON. Free, open source, no proxies.

A spider to crawl webpages

Website Penetration Testing Tool With Dos Attack Feature

Use GPTparser with your OpenAI API to scrape & parse files into structured JSON files.

This is a website url scraper built using python.

Download ALL the images (JPEG/GIF/PNG) from any Tumblr website! This project employs Python3 and BeautifulSoup4 to scrape a Tumblr site (with the url provided by the user) to download, page by page, all the images from the Tumblr site's posts. Ideal for archiving other peoples' Tumblrs <3

This script scrapes the verses and references from an openbible.info page into a JSON file - if needed, we use bible-api.com to translate to another bible version.

AI Media Studio summarizes websites, YouTube videos, documents, images, audio, and video through a desktop/web AI workspace.

An free and easy to use website dumper tool.

A python Script for automatically collect links from a web page.

🕷️ | ReconX is a Live-Website Crawler made to gather critical information with an option to take a picture of each site crawled!

Scrapes any website to retrieve all hyperlinks from it in a matter of seconds. Scraping made easy!