GitHub - SayantikaGhosh/realtime-data-pipeline: Real-time data pipeline simulating e-commerce activity using Kafka, Spark, and Delta Lake. Docker containerizes components. Bronze and Silver layers done; Gold layer and Supabase sync in progress. Demonstrates scalable, real-time ETL.

SayantikaGhosh / realtime-data-pipeline Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Real-time data pipeline simulating e-commerce activity using Kafka, Spark, and Delta Lake. Docker containerizes components. Bronze and Silver layers done; Gold layer and Supabase sync in progress. Demonstrates scalable, real-time ETL.

0 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 9 Commits
.vscode		.vscode
consumer		consumer
deltalake		deltalake
gold_to_sb		gold_to_sb
producer		producer
spark-jars		spark-jars
spark		spark
docker-compose.yml		docker-compose.yml
temp.txt		temp.txt
test.py		test.py