A massively parallel, high-level programming language

An extremely fast Python package and project manager, written in Rust.

Minimalist ML framework for Rust

Official implementation of Half-Quadratic Quantization (HQQ)

Apache DataFusion Comet Spark Accelerator

Distributed DataFrame for Python designed for the cloud, powered by Rust

A high-throughput and memory-efficient inference and serving engine for LLMs

🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI

MLX: An array framework for Apple silicon

Inference Llama 2 in one file of pure C

Distribute and run LLMs with a single file.

Ecosystem of libraries and tools for writing and executing fast GPU code fully in Rust.

Rust bindings for the Python interpreter

BtrBlocks: Efficient Columnar Compression for Data Lakes (SIGMOD 2023 Paper)

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

LST-Bench is a framework that allows users to run benchmarks specifically designed for evaluating Log-Structured Tables (LSTs) such as Delta Lake, Apache Hudi, and Apache Iceberg.

A reference implementation of a Kubernetes scheduler written in Rust

A tiny JVM written in Rust. Learning project

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Technical blogs around data collaboration, data management, and building collaborative applications.

Semantic Indexer

Finetune ALL LLMs with ALL Adapeters on ALL Platforms!

Instruct-tune LLaMA on consumer hardware

English SDK for Apache Spark

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

Approx nearest neighbor search in Rust

Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

🦜🔗 Build context-aware reasoning applications