This project is a Flask web application that allows users to scrape web pages, perform sentiment analysis, text classification, and language detection on the extracted data.
- Web scraping using BeautifulSoup
- Sentiment analysis with TextBlob
- Text classification using Hugging Face Transformers
- Language detection with langdetect
- Downloadable CSV file of the extracted data
-
Clone the repository:
git clone <repository-url> cd MP_09
-
Install the required packages:
pip install -r requirements.txt
-
Run the application:
python app2.py
-
Open your web browser and go to
http://127.0.0.1:3000
. -
Enter the URL, tag, class name, and file name in the form, and select any additional analysis options.
-
Click the "Scrape" button to extract data and download the results as a CSV file.