An Open Standard for lineage metadata collection

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

The Python programming language

Use git repo data (latest tag, current commit hash, etc) for building a version number according PEP-440

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

asyncio client for kafka

FastAPI framework, high performance, easy to learn, fast to code, ready for production

The world's fastest open query engine for sub-second analytics both on and off the data lakehouse. With the flexibility to support nearly any scenario, StarRocks provides best-in-class performance …

Apache Doris is an easy-to-use, high performance and unified analytics database.

Change data capture for a variety of databases. Please log issues at https://issues.redhat.com/browse/DBZ.

Apache Doris Website

Data validation using Python type hints

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

Apache Spark - A unified analytics engine for large-scale data processing

GDPR focused EmbedVideo. Supports YouTube, Twitch, Spotify and SoundCloud

A Spark plugin for reading and writing Excel files

ITSumma Spark Greenplum Connector

A curated list of awesome Apache Spark packages and resources.

Collect, aggregate, and visualize a data ecosystem's metadata

📈 Capturing JVM- and application-level metrics. So you know what's going on.

The leading native Python SSHv2 protocol library.

Documentation and website for OpenLineage

⌚ Get the "last updated" time for each Sphinx page from Git

OpenMetadata is a unified platform for discovery, observability, and governance powered by a central metadata repository, in-depth lineage, and seamless team collaboration.