An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

📚 C/C++ 技术面试基础知识总结，包括语言、程序库、数据结构、算法、系统、网络、链接装载库等知识及面试经验、招聘、内推等信息。This repository is a summary of the basic knowledge of recruiting job seekers and beginners in the direction of C/C++ technology, in…

Caffe: a fast open framework for deep learning.

A library for efficient similarity search and clustering of dense vectors.

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Cross-platform, customizable ML solutions for live and streaming media.

Productive, portable, and performant GPU programming in Python.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

Distribute and run LLMs with a single file.

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning …

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

超轻量级中文ocr，支持竖排文字识别, 支持ncnn、mnn、tnn推理 ( dbnet(1.8M) + crnn(2.5M) + anglenet(378KB)) 总模型仅4.7M

Tensor library for machine learning

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports comp…

High-speed Large Language Model Serving for Local Deployment

A flexible, high-performance serving system for machine learning models

Header-only C++/python library for fast approximate nearest neighbors

百度NLP：分词，词性标注，命名实体识别，词重要性

Fast inference engine for Transformer models

Future versions with model training module will be maintained through a forked version here: https://github.com/seasalt-ai/snowboy

MITIE: library and tools for information extraction

A Toolkit for Industrial Topic Modeling

FAQ-based Question Answering System

KenLM: Faster and Smaller Language Model Queries

Deep Learning Based Free Mobile Real-Time Face Landmark Detector. Contact:jack-yu-business@foxmail.com

TextBoxes++: A Single-Shot Oriented Scene Text Detector

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.