图片爬虫，爬 http://www.girl-atlas.com 整个网站的图片
- gentoo 内核版本：3.14.14
- python 2.7.7
- requests 发送http请求，下载图片
- lxml 解析html文件
- grequests 基于gevent的异步http请求库，加快爬取速度
- get_image.py 每次发送一个请求,超时重连3次。
注：可以在get_images函数中修改图片存放目录
-
Notifications
You must be signed in to change notification settings - Fork 0
kaka-milan-22/spider-girl
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published