Lightweight data compare tool. Use case: you have an unversioned folder with files on one system and the same folder on another. You want to reduce the risk of changes going unnoticed. Use this tool to check if and where are the differences quickly.
Data Engineering Services for Alterra Academy Capstone Project - Team 7
As part of my Data Engineering professional development, I am developing an array of data pipelines which extract, transform and load the data from various sources such as this Quandal API, CSV, JSON and database such as Google BigQuery, Microsft SQL Server and PostgreSQL, just to name a few.
Learn about Data Engineering ⛏️, Data Pipelines Building 🪈 ,Batch Processing 🥅and Data Streaming 🎏 with PostgreSQL, Docker, dbt , AirFlow ,Airbyte, Spark and Kafka
Data Pipeline for Text to Speech Project
Add a description, image, and links to the data-pipepline topic page so that developers can more easily learn about it.
To associate your repository with the data-pipepline topic, visit your repo's landing page and select "manage topics."