Skip to content
/ Youtube-Data-Harvesting-and-Warehousing Public

This project aims to harvest data from YouTube using Python scripting and store it in a NoSQL (MongoDB) database as a data lake. The harvested data can then be fetched from the NoSQL database and migrated to a SQL (PostgreSQL) database for further analysis.

0 stars 0 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

VIGASHINI22/Youtube-Data-Harvesting-and-Warehousing

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
README.md
README.md
 
 
project.scripts.py
project.scripts.py
 
 
requirements.txt
requirements.txt
 
 

Repository files navigation

YouTube Data Harvesting and Warhousing

  • This project aims to harvest data from YouTube using Python scripting and store it in a NoSQL (MongoDB) database as a data lake.

  • The harvested data can then be fetched from the NoSQL database and migrated to a SQL (PostgreSQL) database for further analysis. Additionally, SQL queries can be executed on the postgreSQL database to answer specific questions related to the uploaded channel information.

Prerequisites Before running the scripts, make sure you have the following dependencies installed:

Python 3.9 or later

MongoDB

PostgreSQL

About

This project aims to harvest data from YouTube using Python scripting and store it in a NoSQL (MongoDB) database as a data lake. The harvested data can then be fetched from the NoSQL database and migrated to a SQL (PostgreSQL) database for further analysis.

Resources

Readme
Activity

Stars

0 stars

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages