A Smart Traffic Management System for Ho Chi Minh City, Vietnam leveraging batch and real-time data processing, intuitive dashboards, and monitoring tools to optimize traffic flow, enhance safety, and support sustainable urban mobility through advanced analytics and user-friendly applications.

Azure HDInsight Operators For Apache Airflow

Big Data Technologies can be defined as software tools for analyzing, processing, and extracting data from an extremely complex and large data set with which traditional management tools can never deal

Apache NiFi - Apache MiniFi - TLink SmartPlug

Big Data Analysis

SF crime data analysis with Apache Spark

Production-ready Wikipedia crawler with PySpark and Apache Hive integration. Extracts article data and stores it in Hive with Parquet format and date partitioning.

Big Data project integrating Polymarket prediction data and Binance cryptocurrency rates to analyse relationships between market expectations and real prices.

This script generates random metadata for the Hive metastore.

An automated engine that bridges Data Engineering and System Architecture. It fetches real-world Kaggle datasets and dynamically generates professional pipeline diagrams using Architecture-as-Code (AaC)

Database client designed to be light and accessible