Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

A General-purpose Task-parallel Programming System using Modern C++

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

Tengine is a lite, high performance, modular inference engine for embedded device

Fast inference engine for Transformer models

LightSeq: A High Performance Library for Sequence Processing and Generation

A framework for high-performance medical image processing, neural network inference and visualization

Serving Inside Pytorch