medium-scraper

An article scraper and opener for medium to bypass the article limit for non members
Medium limits the number of articles non-members can read to only a few per month. If you are not signed in you can read as many as you want, however you miss out the recommendations tailored to you. This program signs in and scrapes out your daily recommendations based on your reading history and stores them. Then it opens these in a logged out window so that the number of articles are not limited and you also get to read your recommendations.

The articles are finally saved as pdf locally and sent via smtp mail service so that it can be accessed from your phone

Dependencies and requirements

• Python 3.7.3
• Selenium 3.141.0
• ChromeDriver 2.41.578700
• pdfkit

Usage

• First change the username and password to match yours in the scrape.py(Only google sign in).
• Increase the delay time and scroll down when the medium home page opens if you want to load more articles.
• All the scraped article's links will be stored in articles.txt.
• To read run read.py(Change the article limit if you want to open more articles at once)
• All the opened articles will be stored in read.py and not opened again
• If you want to save the articles as pdf and send via mail run savepdfandsend.py
• The scraping and sending scripts can be automated to be run daily by using anacron if you are a linux user