Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

Apache Spark Connect Client for Rust

Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!

Apache Spark Connect for Rust

velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docker Compose.

Extension to {sparklyr} that allows you to interact with Spark & Databricks Connect

A reverse proxy server which allows secure connectivity to a Spark Connect server

Study system for the Databricks Certified Associate Developer for Apache Spark 3.5 exam. 5 interconnected Claude Code skills covering all 7 exam sections, with sources linked to Apache Spark 3.5 docs and Damji's Learning Spark 2nd Edition.

Interactive Apache Iceberg debugger for exploring production tables and tracing metadata evolution through real time graph visualization

Docker Compose environment for big data research and machine learning development

An Apache Spark Connect Client for C++.

Collection of articles, using the Literate Programming style, about Data Engineering and Software Tooling in general

The Internals of Spark Connect

Run Spark SQL against your own Spark Connect cluster from Excel - results land in a range, refreshable and chartable, with no backend server (powered by pyspark-connect-web).

A native Apache Spark Connect client for Scala 3: SparkSession/DataFrame/Column/functions API over gRPC.

Spark Connect client library in Rust

Kotlin adapter for Apache® Spark™ Connect JVM with dual-backend serialization and Unity Catalog integration. Bachelor's thesis implementation.

Real-time insights on bike availability using the JCDECAUX API. Data flows through Kafka, processed by Spark, and visualized in a Streamlit app. Deployed on Kubernetes.

Apache Arrow ADBC driver for Apache Spark Connect (Go core, C-ABI shared library, Python DBAPI). Arrow-native, multi-language.

TypeScript client for Apache Spark Connect