A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.

📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.

Jekyll-based static site for The Programming Historian

`scrape_linkedin` is a python package that allows you to scrape personal LinkedIn profiles & company pages - turning the data into structured json.

An API to scrape American court websites for metadata.

COVID-19 Coronavirus data scraped from government and curated data sources.

Scape top GitHub repositories and users based on keywords

Data extraction of Google's COVID-19 Mobility Reports

Intelligent Web Data Extractor

Download Chegg homework-help questions to self-sufficient HTML files

ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all skill levels.

A library to read a YML file with Xpath or CSS Selectors and extract data from HTML pages using them

⚽ Instantly find 🏆EURO 2016 live-streams & highlights, now a Web App!

youtube & tiktok analysis + youchoose recommendation custmizer. backend, extensions, and tooling

Repository for the Mastering Web Scraping in Python: Scaling to Distributed Crawling blogpost with the final code.

🔎 um bot de Web Scraping para mostrar vagas do LinkedIn

TV Series is a tool that scrapes Episode Synopsis' of popular TV Series' from websites like Wikipedia / IMDb and show in one place with a user-friendly navigation UI.

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

Main API Flight Git Repository

🕸 List of mini projects that involve web scraping 🕸