A portable Datamart and Business Intelligence suite built with Docker, Mage, dbt, DuckDB and Superset
-
Updated
Apr 5, 2026 - Dockerfile
#
mage-ai
Here are 36 public repositories matching this topic...
The Zoomcamp MLOps Course covers tools like MLflow, Mage, Flask, Prometheus, Evidently, Grafana, Prefect, Terraform, and GitHub Actions. It emphasizes experiment tracking, model deployment, monitoring, CI/CD, and orchestration, culminating in an end-to-end project integrating best practices in MLOps.
flask aws streaming monitoring mongodb model grafana orchestration batch-processing prefect mlops mlflow mage-ai
-
Updated
Feb 18, 2025 - Jupyter Notebook
The CNPJ Data ETL Pipeline is designed to automate the download, processing, and storage of public CNPJ data from the Brazilian Federal Revenue. The pipeline is built with Mage.ai and AWS S3 to ensure efficient data management and scalability.
data-storage data-engineering cloud-computing public-data data-processing data-pipeline amazon-s3 etl-pipeline script-automation mage-ai cnpj-data
-
Updated
Feb 3, 2025 - Python
An end-to-end data engineering pipeline project that processes and analyzes Maintenance Work Orders using Mage, Docker, Google BigQuery, MariaDB, and Looker Studio. It features a seamless integration of cloud and open-source tools for scalable data storage, transformation, and visualization.
python bigquery data automation cloud sql database docker-compose virtual-machine excel gcp mariadb orchestration data-engineering maintenance database-schema compute-engine work-orders visualization-dashboard mage-ai
-
Updated
Dec 9, 2025 - Python
End-to-end data engineering project
-
Updated
Jul 19, 2023 - Jupyter Notebook
Mage AI pipeline: scrape Amazon products & reviews with Bright Data APIs, analyze sentiment with Gemini AI, visualize on Streamlit. Docker setup.
-
Updated
Feb 18, 2026 - Python
An end to end Data Engineering Project
data-engineering data-analytics data-modeling python-pandas data-visualization-project data-engineering-pipeline gcp-project looker-studio mage-ai
-
Updated
Jan 23, 2024 - Jupyter Notebook
Data modeling and ETL pipeline for data analytics on Uber dataset using Google cloud storage, BigQuery, and Looker Studio
-
Updated
Sep 19, 2023 - Jupyter Notebook
A data engineering project built around Smogon's Stats API.
-
Updated
Nov 21, 2024 - Python
An end-to-end data engineering project using Amazon S3, EC2, mage.io, Google BigQuery and Looker.
-
Updated
Aug 12, 2023 - Jupyter Notebook
Solutions for @DataTalksClub's Data Engineering Zoomcamp 2024.
python docker workflow data-science database etl docker-compose orchestration datascience data-engineering data-analysis etl-pipeline de-zoomcamp mage-ai
-
Updated
Mar 4, 2024 - Jupyter Notebook
ETL pipeline that loads sensor data from parquet files into PostgreSQL. Built with Mage.ai for orchestration and Docker for containerization.
python docker pipeline etl postgresql jupyter-notebook pandas data-engineering parquet sensor-data bulk-inserts mage-ai
-
Updated
Apr 28, 2026 - Jupyter Notebook
Docker image for Mage AI deployment using Docker
-
Updated
Dec 23, 2024 - Dockerfile
End-to-end Data Engineering pipeline analyzing tech job market trends using GCP, Terraform, Mage, and dbt. Correlates 1M+ rows of Stack Overflow developer interest with real-time job demand.
python bigquery sql big-data etl terraform google-cloud-storage gcp data-engineering data-analytics dbt data-pipeline mage-ai skills-analysis
-
Updated
Mar 26, 2026 - Python
This project showcases a data engineering pipeline using Google Cloud Platform (GCP) for analyzing taxi trips data from New York City. The pipeline includes steps such as data collection, storage setup, ETL processing, database creation, and data visualization.
python bigquery dashboard google-cloud-storage data-engineering data-analysis google-cloud-platform data-modeling google-compute-engine etl-pipeline google-looker-studio mage-ai
-
Updated
Mar 5, 2024 - Jupyter Notebook
ETL workflow for stock data processing using Mage and PostgreSQL
python etl docker-compose postgresql data-deduplication data-engineering stock-market data-processing financial-data data-modeling data-cleaning data-aggregation api-integration alpha-vantage mage-ai
-
Updated
Jan 17, 2025 - Python
A full data pipeline project. from the ETL to the Dashboard
-
Updated
May 25, 2023 - Jupyter Notebook
-
Updated
Jan 8, 2024 - Python
Improve this page
Add a description, image, and links to the mage-ai topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mage-ai topic, visit your repo's landing page and select "manage topics."