Skip to content

Simple python code to generate links with dates. Project can be used to download The Hindu newspaper

Notifications You must be signed in to change notification settings

ndubey/python-link-creator-downloader

Repository files navigation

My brother needed a utility download all the news papers The Hindu. There was a site hosting all the archived news papers day wise but you can only download single day paper at a time. This simple utility will first generate all the links in proper order for the papers and then with wget you can download the links in the text file.

Just run (double click on) the batch file download_all_from_text_file.bat

it should in general work

If there is any break due to internet connection. you have to manually check till where files have been downloaded and delete everything before that from the list of urls in text file. This should be easy as everything is arranged in increasing order of day.

##Technical detail:

wget.exe is gnu free utility to download any thing from web. It can take urls from a text file also and download.

command used here :

wget.exe --no-check-certificate -i url_list.txt

--no-check-certificate option because wget is not able to get the proper certificate for https.

url_list.txt file has all the urls you need to download

printAllLinks.py generate the txt file in proper format.

About

Simple python code to generate links with dates. Project can be used to download The Hindu newspaper

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published