Efficient Triton Kernels for LLM Training
-
Updated
Aug 3, 2026 - Python
#
triton-kernels
Here are 27 public repositories matching this topic...
FlagGems is an operator library for large language models implemented in the Triton Language.
-
Updated
Aug 3, 2026 - Python
LLM notes, including model inference, transformer model structure, and llm framework code analysis notes.
-
Updated
Aug 1, 2026 - Python
A light llama-like llm inference framework based on the triton kernel.
-
Updated
Aug 1, 2026 - Python
Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.
-
Updated
Jul 6, 2026 - Jupyter Notebook
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
retrieval encoder inference embeddings ner serving rag colbert ml-infra-deployments vllm gliner multimodal-rag ai-infrastructure colpali triton-kernels vllm-plugins
-
Updated
Jul 6, 2026 - Python
Universal AI Runtime — Execute any model on any hardware
-
Updated
Aug 3, 2026 - Python
A "standard library" of Triton kernels.
-
Updated
Oct 2, 2025 - Python
High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.
semantic-search-engine on-premise colbert-ai multivector quantizations retrieval-augmented-generation vector-databases rag-pipeline multimodal-rag colpali triton-kernels late-interaction multivector-search multivector-embeddings
-
Updated
Jul 6, 2026 - Python
Manifold-Constrained Hyper-Connections with fused Triton kernels for efficient training
-
Updated
Mar 10, 2026 - Python
Educational resource demonstrating common GPU programming pitfalls and solutions using Triton kernels.
-
Updated
Feb 26, 2026 - Jupyter Notebook
Official Code for the paper ELMO : Efficiency via Low-precision and Peak Memory Optimization in Large Output Spaces (in ICML 2025)
chunking multi-label-classification extreme-classification low-precision-training large-output-space float8 triton-kernels gradient-fusion
-
Updated
Feb 27, 2026 - Python
A from-scratch nano-Triton and nano-Helion: the modern GPU-kernel DSL stack, rebuilt in ~4,000 lines
-
Updated
Jul 25, 2026 - Python
KernelHeim – development ground of custom Triton and CUDA kernel functions designed to optimize and accelerate machine learning workloads on NVIDIA GPUs. Inspired by the mythical stronghold of the gods, KernelHeim is a forge where high-performance kernels are crafted to unlock the full potential of the hardware.
-
Updated
May 5, 2026 - Python
LLM agents that generate, verify, and evolve Triton GPU kernels. Includes a reward-hack-resistant benchmarking harness with strict correctness verification and fresh-input evaluation. Achieves up to 174.7× over PyTorch eager and outperforms FlexAttention (1.48×) and SDPA (1.17×) on selected workloads.
inference openai evolutionary-algorithms automatic-code-generation large-language-models agentic-workflow agentic-ai triton-kernels kernel-optimization gepa harness-engineering agentic-kernel-generation
-
Updated
Jul 9, 2026 - Python
A container of various PyTorch neural network modules written in Triton.
-
Updated
Mar 31, 2026 - Python
Better and Faster Implementation Dynamic Dilated Pyramid Module from HDFNet (ECCV 2020)
-
Updated
Jul 24, 2026 - Python
Research on implementing a custom Triton kernel for Fast-dLLM v2 and other Diffusion LLMs in order to produce model runtime speedups.
-
Updated
Jul 27, 2026 - Python
Reproducible benchmark suite and tuned Triton fused-MoE configs for NVIDIA H20 LLM inference. 24 configs, 36 perf data points, geomean 1.09× / peak 1.74× speedup.
benchmark triton moe hopper h20 kernel-tuning mixture-of-experts bf16 llm fp8 vllm llm-inference qwen mixtral deepseek sglang triton-kernels nvidia-h20 fused-moe
-
Updated
Jun 2, 2026 - Python
ASR Pipeline (GLM-ASR) optimized using custom Triton kernels (achieving a 72.2% improvement in speed)
-
Updated
May 12, 2026 - Python
Improve this page
Add a description, image, and links to the triton-kernels topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the triton-kernels topic, visit your repo's landing page and select "manage topics."