Official Rust implementation of Apache Arrow

Ready-to-run Docker images containing Jupyter applications

Nessie provides Git-like capabilities for your Data Lake

Apache Iceberg (Incubating)

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Apache Avro is a data serialization system.

An open-source storage layer that brings scalable, ACID transactions to Apache Spark™ and big data workloads.

Apache Parquet

Apache Spark

Scaling Python Machine Learning

NVIDIA device plugin for Kubernetes

A Ray port of the message backend

Arctic is a streaming lake warehouse service open sourced by NetEase

Apache Flink

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

Generation of diagram and flowchart from text in a similar manner as markdown

New Generation Opensource Data Stack Demo

Java Abstracted Foreign Function Layer

Apache Superset is a Data Visualization and Data Exploration Platform

JNI binding for Zstd

DataStax Spark Cassandra Connector

Scalable, redundant, and distributed object store for Apache Hadoop

dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks

Python bindings to the Zstandard (zstd) compression library

Querybook is a Big Data Querying UI, combining collocated table metadata and a simple notebook interface.

The official home of the Presto distributed SQL query engine for big data

Ray tutorials from Anyscale