This is a repository for logging my journey of learning Data Engineering.
-
Data Modelling Project - Wealth Dataset (https://youtu.be/POjDCe-_G8k?si=rapVj0xdX5Iy26sp) Technologies Used - Python, Postgres
-
Realtime Streaming Project - Random User API (https://www.youtube.com/watch?v=GqAcTrqKcrY) Technologies Used - Python, Airflow, Postgress, Kafka, Zookeeper, Spark and Cassandra
-
Scraping Project - https://www.youtube.com/watch?v=8dTpNajxaH0 Technologies Used - Python, BeautifulSoup