A WebGPU-accelerated ONNX inference run-time written 100% in Rust, ready for native and the web

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

IM Chat

NVR with realtime local object detection for IP cameras

A fast, easy-to-use, production-ready inference server for computer vision supporting deployment of many popular model architectures and fine-tuned models.

NEW - YOLOv8 🚀 in PyTorch > ONNX > OpenVINO > CoreML > TFLite

YOLOv8 using TensorRT accelerate !

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

YOLOv8 TensorRT C++ Implementation

TensorRT C++ API Tutorial

Tutorials for creating and using ONNX models

RTSP 1.0 client and server library for the Go programming language

EILEV: Efficient In-Context Learning in Vision-Language Models for Egocentric Videos

Google AI SDK for Dart

ezkl is an engine for doing inference for deep learning models and other computational graphs in a zk-snark (ZKML). Use it from Python, Javascript, or the command line.

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

A STARK-based ZKVM which aims to Programmable Scalability, Programmable Privacy

A curated list of awesome things related to learning Zero-Knowledge Proofs (ZKP).

Command line tool for displaying and adding C2PA manifests

Rust SDK for the core C2PA (Coalition for Content Provenance and Authenticity) specification

Files to run a lighthouse / geth client pair on Ethereum EIP-4844 / Deneb devnet for testing

Danksharding Builder with GPU acceleration

Go core implementation of the iden3 system

Rust implementation of {t,n}-threshold ECDSA (elliptic curve digital signature algorithm).

Examples and recipes for Llama 2 model

(Golang) Go bindings for Discord