A multi-threaded python based web crawler that gathers links present in a web page of the same domain as of the given web page and write them to a .txt file.
- Compile and run main.py
- Paste URL of the webpage you want to search links for when prompted to.
- Viola! You have a directory named Spy-Web with all the links in the domain of the given webpage.