A Simple WebCrawler Made In Python for exploring and downloading content from web pages within a given Domain/URL.
- This Tool Crawls The Given URL/Domain And Collects The HTML File Of Each WebPage And Compresses Them Into Zip Archive For Downloading.
- My First Original Tool ^_^
apt update -y
apt upgrade -y
pkg install python -y
pkg install git
git clone https://github.com/Th3-C0der/Web-Crawler
ls
cd Web-Crawler
pip install -r requirements.txt
cd Web-Crawler
python main.py
- Open This Url On Your Browser
http://127.0.0.1:5000
- To Update Script →
python update.py