This is a code repo dedicated to following a data engineering bootcamp. As we make progress on the course, I am adding my thoughts, approach and solutions.

The data engineering project aims to migrate a company's on-premises database to Azure, leveraging Azure Data Factory for data ingestion, transformation, and storage. The project will implement a three-stage storage strategy, consisting of bronze, silver, and gold data layers (Medalion architecture). Documentation of the project is in PDF file.

It is a hands-on project to gain experience in developing network-based monitoring systems using TCP/IP, Azure Cloud, and automation scripting. By working through this project, you will gain real-world exposure to networking, client-server architecture, PowerShell automation, cloud deployment, and infrastructure monitoring practices.

This repo is basically about different labs and tasks performed during HCCDA-TechEssentials program