A collection of AI skills for working with Dagster
-
Updated
Jun 1, 2026 - Python
#
data-orchestration
Here are 34 public repositories matching this topic...
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
python docker airflow sql database s3 s3-bucket data-visualization python3 data-warehouse metabase data-engineering data-analytics data-analysis redshift data-processing data-cleaning data-warehousing data-orchestration
-
Updated
Apr 18, 2020 - Python
Build and ship production ML pipelines faster: a pipeline library with an optional self-hosted visual layer for modular, reproducible workflows, local testing, and experiment tracking.
react redis machine-learning deep-learning docker-compose self-hosted celery visual-programming low-code model-deployment privacy-first mlops ml-pipeline model-registry experiment-tracking local-first data-orchestration mlops-workflow ml-platform-workflow feature-engineering-python
-
Updated
May 27, 2026 - Python
Data-aware orchestration with dagster, dbt, and airbyte
-
Updated
Jan 20, 2023 - Python
A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran
-
Updated
Apr 17, 2026 - Python
Get started with Dagster ASAP
-
Updated
Apr 1, 2025 - Python
A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing
python docker postgres airflow sql database etl data-engineering data-warehousing etl-pipeline data-orchestration
-
Updated
Sep 15, 2021 - Python
Introduction to using and scaling dagster
-
Updated
Oct 14, 2025 - Python
Develop a real-time data ingestion pipeline using Kafka and Spark. Collect minute-level stock data from Yahoo Finance, ingest it into Kafka, and process it with Spark Streaming, storing the results in Cassandra. Orchestrated the workflow using Airflow deployed on Docker.
dockerfile airflow kafka cassandra etl docker-compose jupyter-notebook stream-processing spark-streaming financial-data data-ingestion etl-pipeline data-orchestration
-
Updated
Nov 29, 2024 - Python
EHR pipeline that simulates MIMIC-IV patient data streams, performs advanced feature engineering and clinical severity scoring using machine learning (Random Forest Classifier), and prepares structured outputs for scalable downstream analytics
sql kafka snowflake data-engineering data-analytics data-modeling observability real-time-data data-pipeline workflow-automation metadata-management data-streaming etl-pipeline prefect data-orchestration healthcare-data log-processing events-driven cloud-datawarehouse
-
Updated
Jul 11, 2025 - Python
Code, scripts, and resources for the Data Engineering Fundamentals Course Webinar, covering Python, data pipelines, Apache Airflow, and more.
python sql data-engineering data-pipelines apache-airflow data-orchestration dimensional-modeling data-orchestrator
-
Updated
Dec 4, 2025 - Python
Build an ELT pipeline with dagster and dbt to schedule loading HDB resale transactions in Singapore into Google BigQuery data warehouse, then create Power BI dashboard to enhance insight exploration.
-
Updated
Mar 27, 2025 - Python
Data orchestration repo with Docker deployment
-
Updated
Jan 20, 2023 - Python
Prefect - Data orchestration tool practice & learning
-
Updated
Mar 12, 2023 - Python
Cloud-agnostic Airflow MLOps sandbox combining parallelized data pipelines with ML engineering tooling (MinIO, MLflow, Qdrant, RAPIDS) for end-to-end experimentation and observability.
python machine-learning airflow big-data deep-learning etl parallel-computing data-orchestration llms
-
Updated
Jan 13, 2026 - Python
A poor-man's data lake fill with ducks
python docker docker-compose data-visualization data-analytics data-processing datalake geospatial-processing geospatial-analysis dagster data-orchestration traefik-v2 traefik-docker duckdb
-
Updated
Jun 22, 2023 - Python
📡 Modern Data Orchestration: Multi-layer ETL pipeline (Raw→Business) using Dagster for cable modem signal analytics.
-
Updated
Apr 19, 2026 - Python
Trying out Data Engineering
data-science data sql python3 data-engineering parquet dbt data-pipeline cold-storage prefect data-orchestration streamlit duckdb hot-storage
-
Updated
Mar 15, 2026 - Python
Improve this page
Add a description, image, and links to the data-orchestration topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the data-orchestration topic, visit your repo's landing page and select "manage topics."