INFO-SPIDER 是一个集众多数据源于一身的爬虫工具箱🧰，旨在安全快捷的帮助用户拿回自己的数据，工具代码开源，流程透明。支持数据源包括GitHub、QQ邮箱、网易邮箱、阿里邮箱、新浪邮箱、Hotmail邮箱、Outlook邮箱、京东、淘宝、支付宝、中国移动、中国联通、中国电信、知乎、哔哩哔哩、网易云音乐、QQ好友、QQ群、生成朋友圈相册、浏览器浏览历史、12306、博客园、CSDN博客、开源中国博客、简书。

Python爬虫实战 - 模拟登陆各大网站 包含但不限于：滑块验证、拼多多、美团、百度、bilibili、大众点评、淘宝，如果喜欢请start ❤️

基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

A Facebook crawler

Advanced python library to scrap Twitter (tweets, users) from unofficial API

🕵️ Python project to crawl for JavaScript files and search for secrets like API keys, authorization tokens, hardcoded password or related.

知乎模拟登录，支持提取验证码和保存 Cookies

Crawl telegra.ph searching for nudes!

geetest，滑动验证码

腾讯新闻、知乎话题、微博粉丝，Tumblr爬虫、斗鱼弹幕、妹子图爬虫、分布式设计等

SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance with multiple mode and configurations.

滑动验证码，希望对你们有所帮助❤️

A universal solution for web crawling lists. 抓取网页列表的通用解决方案

免费 IP 代理池。Scrapy 爬虫框架插件

一个简单的分布式爬虫框架

GroqCrawl is a powerful and user-friendly web crawling and scraping application built with Streamlit and powered by PocketGroq. It provides an intuitive interface for extracting LLM friendly AI consumable content from websites, with support for single-page scraping, multi-page crawling, and site mapping.

爬取及整理Freebuf\安全客\先知\知道创宇等站点的”web安全“类优质文章

摸鱼神器：在命令行中看今日头条

组合多请求，抓取结构化数据，基于scrapy组件