This repo contains a full-fledged Python-based script that scrapes a JavaScript-rendered website, cleans the data, and pushes the results to a cloud-based database. The workflow is orchestrated on Airflow to run automatically

Scrape-AI is a Python library for intelligent web scraping using LLMs like, OpenAI, Anthropicand Selenium. It dynamically fetches data based on user queries, enabling agent-like scraping with configurable models, modular design, and support for real-time data extraction from dynamic websites.

Python Selenium scraper that automatically scrolls and extracts quotes, authors and tags from a JavaScript loaded website. Saves to Excel.

A Python-based web scraping tool that automates data extraction from websites using Selenium and browser automation. Built for scalable scraping workflows, cross-browser testing, and structured data collection, with support for dynamic web pages and automated processing.

Modular Python application that analyzes the structure and content of any website. WebExtractor is cross-platform and works on macOS, Windows, and Linux.

This repo contains a scraping script that crawls a JavaScript-rendered website using the scrapy-playwright package in Python and the scrapy framework