smart substation connection and configuration software based on IEC 61850 protocal and SCD file. Email: 570503271@qq.com

Data Warehousing ETL Demo with Apache Iceberg on EMR Local Environment

How to manage SCD2 with Apache Hive 1.1 and HBase 1.2 w/o HiveQL UPDATE operation

Python Driver for Sensirion I²C Carbon Dioxid Sensor - SCD40, SCD41

Python ETL pineline craws data from Weather Forecast, transforms and loads to MySQL

Source code for the python package: delta-hybrid-scd

A data pipeline on GCP Dataproc using Sqoop, HDFS, Hive, and PySpark to implement SCD Type 2 for an e-commerce use case. Tracks customer and product changes (e.g., address, price) and their impact on sales, demonstrating scalable data warehousing and processing.