A powerful web content crawler with LLM-powered RAG (Retrieval Augmented Generation) capabilities. CrawlGPT extracts content from URLs, processes it through intelligent summarization, and enables natural language interactions using modern LLM technology.
IMDb Movie Scraper A web scraper that extracts movie titles and release years from IMDb’s Top Chart using Selenium and BeautifulSoup for efficient data handling. 🔹 Key Features: Extracts titles & release years Handles JavaScript-heavy pages User-Agent rotation for stealth Saves data in JSON/CSV Optimized for large-scale scraping
# Web Scraper Project A versatile web scraper for data and news articles
Web harvesting system for the Faller catalog, with automated extraction of product data, images, and documentation. Includes a Flask web interface and a SQLite database for structured storage and management.
Add a description, image, and links to the data-extraction-from-websites topic page so that developers can more easily learn about it.
To associate your repository with the data-extraction-from-websites topic, visit your repo's landing page and select "manage topics."