☁️ Build multimodal AI applications with cloud-native stack

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Turns Data and AI algorithms into production-ready web applications in no time.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

Always know what to expect from your data.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.

📚 Parameterize, execute, and analyze notebooks

Machine Learning Pipelines for Kubeflow

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.

Blender addons that improve the game development workflow between Blender and Unreal.

Python library for creating data pipelines with chain functional programming

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

HuixiangDou: Overcoming Group Chat Scenarios with LLM-based Technical Assistance

PyTorch extensions for fast R&D prototyping and Kaggle farming

MLBox is a powerful Automated Machine Learning python library.

Data intensive science for everyone.