azuredatalakegen2

Star

Here are 17 public repositories matching this topic...

SAI-MOHAN-B / Capstone-Project-Lakehouse-Platform-Implementation

Star

An end to End Implementation of the data lakehouse architecture

azure-storage azuredevops azuredatalakegen2

Updated Sep 19, 2024
Python

shanukatiyar111 / AzureProject1

Star

END TO END DATA ENGINEERING PROJECT

azure powerbi azuredatafactory azureactivedirectory azurekeyvault azuredatabricks azuredatalakegen2 azuresynapseanalytics

Updated Jul 12, 2024

SAI-MOHAN-B / FootballDataEngineering

Star

An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Azure Data Lake. Other processing takes place on Azure Data Factory, Azure Synapse and Tableau.

azure adf azure-storage azuredatalakegen2

Updated Aug 29, 2024
Python

sairajindroju / TokyoOlympicDataAnalytics-Azure

Star

Ingested Tokyo Olympic data into Azure Data Lake using Azure Data Factory. Enhanced data quality with Apache Spark on Azure Databricks. Optimized SQL queries on Synapse Analytics, reducing execution time. Developed engaging Power BI dashboards, boosting user engagement creating KPI's with DAX.

python sql apache-spark dashboard azure dataengineering azuredatafactory azuredatabricks dataana azuredatalakegen2 azuresynapse synapseanalytics

Updated Mar 5, 2024
Jupyter Notebook

UcheIgbokwe / FormulaOneDataETL

Star

Collection of data on Formula One Racing

python spark databricks datalake azuredatabricks azuredatalakegen2

Updated Dec 21, 2022
Python

vigneshSs-07 / Azure-Cloud

Star

This repo explains all services provide by azure related to AL-ML services.

azure azure-storage azure-storage-blob azurekeyvault azurecloudshell azure-devops azuremachinelearning azurehdinsight azuredatalakegen2

Updated Dec 31, 2022

svSriramFF / Customer-Lifetime-Analysis-on-Retail-sales-data-of-Amazon

Star

The aim of this project is to build a cost efficient Data Warehouse on Amazon's Retail sales data and perform Customer lifetime value analyses.

powerbi azuredatafactory azuredatalakegen2 azuresynapse

Updated Oct 8, 2023
TSQL

amanjot-git / AzureSQL

Star

Learning Azure Data Fundamentals of Relational and Non Relational Data with Microsoft Learn Platform

microsoft sql fabric azure portal powerbi azureblob dp-900 azuredatalakegen2 azuresynapse

Updated Mar 22, 2024
Jupyter Notebook

skalskibukowa / Project_Azure_Data_Engineer

Star

The data engineering project aims to migrate a company's on-premises database to Azure, leveraging Azure Data Factory for data ingestion, transformation, and storage. The project will implement a three-stage storage strategy, consisting of bronze, silver, and gold data layers (Medalion architecture). Documentation of the project is in PDF file.

cloud azure keyvault azure-storage datawarehouse databricks azuredatafactory azuresqldb etl-pipeline azuredatalakegen2 azurecloud

Updated Mar 4, 2024
Python

calhaley / covid19_report_azure_data_factory

Star

Integration of Covid-19 data utilising Azure Data Factory to perform data ingestion, transformation and storage activities. The goal of this guided project was to become familiar with Microsoft Azure technologies, including; Azure Data Factory(ADF), Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Databricks, etc.

python dataflow databricks tsql hdinsight azuredatafactory azuresqldb azuredatastudio azureblobstorage azuredatalakegen2