🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.

Rust bindings to https://github.com/k2-fsa/sherpa-onnx

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

Lightpanda: the headless browser designed for AI and automation

Netmaker makes networks with WireGuard. Netmaker automates fast, secure, and distributed virtual networks.

(Unofficial) PyTorch implementation of grouped-query attention (GQA) from "GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints" (https://arxiv.org/pdf/2305.13245.pdf)

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

The calflops is designed to calculate FLOPs、MACs and Parameters in all various neural networks, such as Linear、 CNN、 RNN、 GCN、Transformer(Bert、LlaMA etc Large Language Model)

Neural building blocks for speaker diarization: speech activity detection, speaker change detection, overlapped speech detection, speaker embedding

Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU su…

Reliable LLM Memory for AI Applications and AI Agents

Empowering RAG with a memory-based data interface for all-purpose applications!

A port of Doom (1993) that runs inside a PDF file

Univer is a full-stack framework for creating and editing spreadsheets, documents, and slides on both web and server.

Video readers, writers, muxers, encoders and decoders for Rust based on ffmpeg libraries.

Converts an RWKV PTH model to SafeTensors.

Implementation of the RWKV language model in pure WebGPU/Rust.

Multiple NVIDIA GPUs or Apple Silicon for Large Language Model Inference?

A dynamic texture atlas allocator with fast deallocation and rectangle coalescing.

The easy way to make a Rust app with a GUI

A tiling layout engine for egui with drag-and-drop and resizing

🐦 Friendly little instrumentation profiler for Rust 🦀

Coz: Causal Profiling

Now everyone can connect safety to elm327 hugs with Begaz

RenderDoc application bindings for Rust

Starter template for winit, egui and wgpu project.

React Native implementation of WebGPU using Dawn

Limbo is a work-in-progress, in-process OLTP database management system, compatible with SQLite.