An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.

An ETL Orchestration using Apache Airflow to extract CSV files from a Google Drive, validate, transform, and load into a PostgreSQL database.

This project demonstrates how to build and automate an ETL pipeline using DAGs in Airflow and load the transformed data to Bigquery. There are different tools that have been used in this project such as Astro, DBT, GCP, Airflow, Metabase.

A comprehensive ELT pipeline for analyzing passenger satisfaction data. Features a modern data architecture with Apache Airflow for extraction, dbt/Snowflake for transformation, Python/Pandas for cleaning, and interactive dashboards for visualization with NextJS.

Reference implementations for orchestration project using Astronomer/Airflow

An example project of how to use local devcontainers with the Astronomer Astro platform

Este projeto tem como objetivo extrair dados da API FIPE utilizando um ambiente Astronomer com Airflow para orquestração das tarefas que facilita o gerenciamento e implantação de fluxos de trabalho.

Preparing for Airlfow Certification - Testing Knowledge -> New Connection of Neurons in Brain with Training++

The Smart Data Warehouse project automates e-commerce data ETL processes using Apache Airflow. It uploads data to Google Cloud Storage, loads it into BigQuery, performs quality checks, and enables visualization in Looker Studio for insightful reporting and analysis.

ETL pipeline with Airflow and astronomer - to automate and scheduling the Weather workflows

Apache Airflow MCP server with Bearer token authentication support for Astronomer and standalone Airflow

Analyse personal Netflix usage

Projeto para Extração de dados de um SQL Server e Carga em um Data Lake Storage Gen2 da Azure (ADLS) usando Airflow Astro CLI e spark para movimentação dos dados entre as camadas tipo medalhão com delta lake.

Sentiment Analysis using DistlBERT Transformer from HuggingFace. Also integrated Airflow for end-to-end pipeline

Pipeline de ELT com airflow, dbt e postgresql

Airflow for end-to-end analytical pipeline for credit card transactions. Detects changes in a Snowflake Stream and triggers a dbt cloud job.

To build ETL Weather Pipeline using AirFlow and Astro.

Chess Data Harmony is an ETL data engineering project using different tools like Python with pandas, AWS S3, Snowflake, all orchestrated by Airflow (Astronomer)