This is the repository of my own personal projects to become better Data Engineer.
-
Spotify Data Modeling Project - Technologies : Python, PostgreSQL, Spotipy Library, and Understanding of Data modeling.
Medium Article Link : https://blog.stackademic.com/data-modeling-using-python-sql-3edc2920ba92
-
Orchestrating Weather ETL Pipeline - Technologgies : Python, PostgrSQL, Airflow, Streamlit and Learned Scheduling Pipeline Flow.
Medium Article Link : https://medium.com/@pooja9900111/orchestrating-etl-pipeline-with-apache-airflow-04860c85d7a2
-
Building Data Warehouse using DBT - Technologies : Python, DBT, PostgresDB, BigQuery, Looker, and Shell
Medium Article Link : https://medium.com/@pooja9900111/building-elt-using-dbt-bigquery-and-looker-fb46baed18ee
-
Google PlayStore Analysis with PySpark - Technologies: Python, Pyspark, SQL
-
Realtime Stock Analysis with Kafka - Technologies: Python, Kafka, GCS, BigQuery