🧙 Build, run, and manage data pipelines for integrating and transforming data.

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com

NucliaDB, The AI Search database for RAG

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable,…

Always know what to expect from your data.

⚡ Data quality testing for the modern data stack (SQL, Spark, and Pandas) https://www.soda.io

A curated list of awesome pipeline toolkits inspired by Awesome Sysadmin

🦉 Data Versioning and ML Experiments

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis

Concurrent data pipelines in Python >>>

Evolution Through Large Models

Data Apps & Dashboards for Python. No JavaScript Required.