CSC603: Data Warehousing and Mining [DWM] & CSL603: Data Warehousing and Mining Lab [DWM Lab] | TE Semester VI | Computer Engineering

This repo provides a step-by-step approach to building a modern data warehouse using PostgreSQL. It covers the ETL (Extract, Transform, Load) process, data modeling, exploratory data analysis (EDA), and advanced data analysis techniques.

Building a modern data warehouse with Microsoft SQL Server, including ETL processes with Bronze Layer, Silver Layer and the Gold Layer, data modeling and as well as analytics.

End-to-end data engineering processes for the NIGERIA Health Facility Registry (HFR). The project leveraged Selenium, Pandas, PySpark, PostgreSQL and Airflow

This repository explores the data and technical architectures needed to enable enterprises to design, develop and deploy business intelligence (BI) and analytical applications that create value from the deluge of data enterprises have access to.

Syracuse University, Masters of Applied Data Science - IST 722 Data Warehouse

End-to-end data engineering pipeline with real-time streaming, cloud processing, and analytics. Built with Apache Kafka, Spark, AWS Glue, and Snowflake using Apache Iceberg tables.

Designed Multi Star schema with 10 Fact & 33 Dimension tables & developed Data Integration Pipeline by ETL workflow to load all tables (380M+ rows) from multiple sources such as CSV, MySQL, MSSQL & PostgreSQL by using Talend. Implemented Data Profiling, Error Handling, Load Statistics, Cleansing and Performance Tuning to address data quality gap…

Building a modern data warehouse with SQL Server, including ETL processes, data modeling and analytics.

A scalable data warehouse solution designed for AI-driven traffic analytics using vehicle trajectory data from swarm UAVs. Built with Airflow for orchestration, dbt for data transformation, PostgreSQL for storage, and Redash for visualization.

This project demonstrates end-to-end ETL pipelines for HR and people analytics. It uses Oracle Database and Apache Airflow to extract, transform, and load data, and generate reports on workforce metrics.

Modeling a database using the Star Schema, applied to the context of "CFB Pharmacy", which seeks to develop decision support systems for revenue analysis. The project was carried out in two stages: (A1) involved the creation of the relational and conceptual model; (A2) focused on the implementation of the dimensional model and Data Warehouse (DW).

✈ An integrated Data Warehouse (DWH) and Business Intelligence (BI) platform for the aviation industry, built for advanced data analysis and interactive reporting.

Showcases work focused on utilizing statistical techniques and machine learning algorithms to forecast future trends and outcomes.

This Project uses the medilion architeture for the Warehouse. In this repo we build a end-to-end system , i.e Extracting raw data from the sources to presenting the data for different data models.

Data Warehouse Basics

End-to-end DWH for Spanish electricity market data – CDC-based ETL, star schema, Power BI dashboards

Airline analytics DWH with SSAS cube and Tableau dashboards built on SQL Server.

Modern Data Stack Template

Building a modern data warehouse with SQL Server, including ETL Processes, Data Modeling and Analytics