web_scraper

Linux command line script for scraping files from the web page into local storage.

This doesnt work on windows operating systems.

Getting to work

1. Clone the repository in your /home/user/ directory
2. Set executable permission to the scraper.sh with sudo chmod +x web_scraper/scraper.php
3. Run the .sh file with ./web_scraper/scraper.sh Then just provide the url to scrape and the script will do the task for you.