Fast ML inference & training for ONNX models in Rust

Highly Performant, Modular and Production-ready Inference, Ingestion and Indexing built in Rust 🦀

Rust wrapper for Microsoft's ONNX Runtime (version 1.8)

A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models.

Automated manga translation tool with LLM, written in Rust.

pyannote audio diarization in rust

Remove backgrounds from images with ease

Infer only tts

Use piper TTS models in Rust

Speech detection using silero vad in Rust

Proxy server for triton gRPC server that inferences embedding model in Rust

Mid-Level Rust Bindings to the C API for Microsoft's ONNX Runtime

Fast, fearless, and fully verifiable ONNX runtime in Rust 🚀⚡🦀

A Lightweight Framework for Building ONNX Runtime Pipelines with ort

rust onnxruntime inference , yolo and other models

A chess bot that plays chess for you automatically without much initial setup that uses machine learning for detecting chessboard and pieces.

Sonori is a fully local STT app for linux (wayland).

ort (onnxruntime) plugin for bevy

Rust Onnx Runtime - a rust binding to onnx runtime

2024 SOTA object detector RT-DETR (CVPR2024, https://github.com/lyuwenyu/RT-DETR) inference using Rust + Ort