WikipediaScraper is a Python-based project designed to extract and process data from Wikipedia. It leverages the Scrapy framework to perform web scraping tasks efficiently.
- Web Scraping with Scrapy: Utilizes Scrapy to navigate and extract information from Wikipedia pages.
- Docker Support: Includes a Dockerfile and docker-compose.yml for containerized deployment.
- Automated Execution: Comes with a run.sh script to streamline the scraping process.