AutomatonX is an advanced CI/CD pipeline automation framework designed to streamline software delivery and deployment processes

This project uses Mage to build a pipeline for ingesting, transforming NYC taxi data, and training a linear regression model. The model and artifact (dict vectorizer) are logged and registered with MLflow.

Workflow manager for building modular processing pipelines with structured configuration and flexible task orchestration

This project implements a Retrieval-Augmented Generation (RAG) pipeline using Mage to manage large language models (LLMs) on an hourly schedule.

This repo gives you insights on the data engineering project I built using public datasets from San Francisco open data portal.