Stock Market Kafka Real Time Data Engineering Project

Introduction

End-To-End Data Engineering Project on Real-Time Stock Market Data using Kafka.

It uses different technologies such as Python, Amazon Web Services (AWS), Apache Kafka, Glue, Athena, and SQL.

Architecture

Technology Used

• Programming Language - Python
• Amazon Web Service (AWS)

1. S3 (Simple Storage Service)
2. Athena
3. Glue Crawler
4. Glue Catalog
5. EC2

• Apache Kafka