A python program to get lists of proxy information from proxy websites.
It will create a sqlite database for proxy information including ip address, port, location and protocol.
Python version must greater than 3.3
Clone the code.
git clone https://github.com/SymeonChen/spider-proxy-pool.git
Install dependency.
sh install.sh
run the apps.
sh run.sh
Now we can get http proxy lists from
http://localhost:5000/api/http
This project is only for learning and reference. The technologies involved in the code are provided by online open and searchable tutorials. The addresses of the third-party sites involved in the project are all related sites retrieved through search engines, which are only used as examples. The project has not been updated for many years, so its accuracy, reliability and integrity are not guaranteed, and it is not responsible for any scenarios of its derivative projects. Any use of the project for illegal purposes shall be stopped immediately.
If you think that the sample website and other information of the project are not conducive to your legitimate rights and interests, you are welcome to give me feedback by email, and I will cooperate reasonably and legally to solve the problem.