A C++ header-only HTTP/HTTPS server and client library

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

Diffusion model(SD,Flux,Wan,...) inference in pure C/C++

MLX: An array framework for Apple silicon

SGLang is a fast serving framework for large language models and vision language models.

Port of OpenAI's Whisper model in C/C++

GGUF Quantization support for native ComfyUI models

A really basic thread-safe progress bar for Golang applications

ASCII table in golang

The Universal Filesystem Abstraction for Go

LLM-based code completion engine

Performance-portable, length-agnostic SIMD with runtime dispatch

GitHub Action to install CUDA

Machine Learning Containers for NVIDIA Jetson and JetPack-L4T

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Inference Llama 2 in one file of pure C

Tensor library for machine learning

FlatBuffers: Memory Efficient Serialization Library

LLM inference in C/C++

Universal LLM Deployment Engine with ML Compilation

Distributed reliable key-value store for the most critical data of a distributed system

Project ACRN hypervisor

Unlock vGPU functionality for consumer grade GPUs.

reuse tcp/udp ports in golang

A book about the internals of the Go programming language.

Expression language and expression evaluation for Go

Graceful process restarts in Go

AWS EKS - kubernetes project and terraform module

Metadata and tooling for the OpenTofu registry

Go实现的Trojan代理，支持多路复用/路由功能/CDN中转/Shadowsocks混淆插件，多平台，无依赖。A Trojan proxy written in Go. An unidentifiable mechanism that helps you bypass GFW. https://p4gefau1t.github.io/trojan-go/