Running this Script would allow the user to scrape any number of articles from dev.to from any category as per the user's choice
In order to run this script, you need to have Python and pip installed on your system. After you're done installing Python and pip, run the following command from your terminal to install the requirements from the same folder (directory) of the project.
pip install -r requirements.txt
As this script uses selenium, you will need to install the chrome webdriver from this link
After satisfying all the requirements for the project, Open the terminal in the project folder and run
python scraper.py
or
python3 scraper.py
depending upon the python version. Make sure that you are running the command from the same virtual environment in which the required modules are installed.
The user needs to enter Category and Number of articles
The scraped pdf files get saved in the folder in which the script is run
