hdinsight

Integration of Covid-19 data utilising Azure Data Factory to perform data ingestion, transformation and storage activities. The goal of this guided project was to become familiar with Microsoft Azure technologies, including; Azure Data Factory(ADF), Azure Data Lake Storage Gen2, Azure SQL Database, Azure Blob Storage, Dataflow, Databricks, etc.

python dataflow databricks tsql hdinsight azuredatafactory azuresqldb azuredatastudio azureblobstorage azuredatalakegen2

Updated Jan 13, 2023
Python

mpfishe2 / store-data-generator

Star

This is a grocery store data generator for emulating batch and real-time POS transactions and sending them to either Azure Event Hubs or Apache Kafka (test with Azure HDInsight Kafka)

streaming real-time kafka azure random-data-generation hdinsight eventhub

Updated Aug 6, 2019
Python

Improve this page

Add a description, image, and links to the hdinsight topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the hdinsight topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

hdinsight

Here are 9 public repositories matching this topic...

hdinsight / hdinsight-kafka-tools

kcheeeung / hive-benchmark

angadsingh / airflow-hdinsight

angadsingh / airflow-ditto

kcm117 / jupyter_local_hdispark_config

AfonsoFeliciano / Azure-Data-Factory-for-Data-Engineers

kcheeeung / hive-testbench

calhaley / covid19_report_azure_data_factory

mpfishe2 / store-data-generator

Improve this page

Add this topic to your repo