RTL implementation of a performance/area optimized bfloat16 adder and multiplication.
-
Updated
Mar 28, 2026 - Verilog
#
bf16
Here are 25 public repositories matching this topic...
Over 60 figures and diagrams of LLMs, quantization, low-rank adapters (LoRA), and chat templates FREE TO USE in your blog posts, slides, presentations, or papers.
supervised-learning data-types lora quantization fine-tuning sft chat-template hugging-face bf16 llm llms low-rank-adaptation fine-tuning-llm
-
Updated
Feb 18, 2025
A flexible utility for converting tensor precision in PyTorch models and safetensors files, enabling efficient deployment across various platforms.
machine-learning deep-learning utilities deployment toolkit optimization pytorch fp16 model-compression model-conversion model-checkpoint bf16 tensor-precision efficient-deployment
-
Updated
Aug 24, 2023 - Python
Fast BF16 PyTorch training operators for standard and low-rank Attention Residuals
-
Updated
Sep 6, 2026 - Python
Systematic 24-hour benchmark study of Qwen3.6-27B inference on dual NVIDIA RTX PRO 6000 Blackwell SM120 (TP=2). 8 experiments comparing repne/vllm fork vs upstream vLLM across FP8/BF16/NVFP4/Q8_0 quants and MTP/DFlash speculative decoding. Peak: 2,083 tok/s at c=32. Quality: KLD vs BF16 = 0.0018 (noise floor).
-
Updated
Jun 3, 2026 - Python
Converts a floating-point number or hexadecimal representation of a floating-point numbers into various formats and displays them into binary/hexadecimal.
-
Updated
Dec 23, 2021 - C
Python implementations for multi-precision quantization in computer vision and sensor fusion workloads, targeting the XR-NPE Mixed-Precision SIMD Neural Processing Engine. The code includes visual inertial odometry (VIO), object classification, and eye gaze extraction code in FP4, FP8, Posit4, Posit8, and BF16 formats.
-
Updated
Aug 17, 2025 - Jupyter Notebook
Auto GGUF Converter for HuggingFace Hub Models with Multiple Quantizations (GGUF Format)
machine-learning cmake ai tensorflow transformers huggingface ai-models huggingface-models bf16 safetensors llama-cpp gguf gguf-models gguf-quantization gguf-editor convert-gguf
-
Updated
Feb 11, 2026 - Python
DeepSeek-OCR-experimental is an advanced, multi-purpose visual document intelligence and object localization sandbox. Powered by the unredacted prithivMLmods/DeepSeek-OCR-Latest-BF16.I64-v2.0 architecture, this suite is designed to deliver highly accurate, structure-aware image text extractions.
torch pytorch accelerate matplotlib addict gradio opencv-python torchvision i64 huggingface-transformers timm bf16 huggingface-spaces flash-attention-2 deepseek-ocr easydict
-
Updated
Jun 27, 2026 - Python
Lossless AI model compression - ~34% smaller with bit-identical weights; the autopilot profiles your machine, picks the highest fidelity that runs, and streams models bigger than your RAM.
pytorch autopilot entropy-coding model-compression huggingface lossless-compression kv-cache bf16 llm fp8 safetensors streaming-inference
-
Updated
Jun 13, 2026 - Python
A TPU-native tiled tensor data structure in Rust: the Padded Tile Lattice — sublane/lane layout, bf16/int8 dtypes, and a CPU reference simulator of systolic dataflow.
-
Updated
Jun 30, 2026 - Rust
Reproducible benchmark suite and tuned Triton fused-MoE configs for NVIDIA H20 LLM inference. 24 configs, 36 perf data points, geomean 1.09× / peak 1.74× speedup.
benchmark triton moe hopper h20 kernel-tuning mixture-of-experts bf16 llm fp8 vllm llm-inference qwen mixtral deepseek sglang triton-kernels nvidia-h20 fused-moe
-
Updated
Jun 2, 2026 - Python
Open, reproducible AMD XDNA1 + Strix Point XDNA2 compute on Linux: pinned builds, CPU-reference checks, persistent C/Python runners, and an LLM roadmap.
linux machine-learning amd hardware-acceleration aie npu edge-ai matmul mlir iree bf16 llm xdna ryzen-ai strix-point neural-processing-unit amdxdna xdna2 xdna1 mlir-aie
-
Updated
Aug 16, 2026 - Shell
Matrix-free 3D SIMP topology optimization with fused gather-GEMM-scatter CUDA kernels on NVIDIA RTX 4090. Companion code for arXiv:2604.18020.
cuda scientific-computing gpu-computing topology-optimization cupy finite-element-methods matrix-free tensorcore bf16 rtx4090
-
Updated
Aug 26, 2026 - Python
🖼️ Enhance text extraction and document parsing with the DeepSeek-OCR model through this Gradio web interface optimized for NVIDIA GPUs.
torch pytorch accelerate matplotlib addict gradio opencv-python torchvision i64 huggingface-transformers timm bf16 huggingface-spaces deepseek-ocr easydict
-
Updated
Sep 6, 2026 - JavaScript
Distributed GPT-2 fine-tuning with PyTorch FSDP and BF16 mixed precision, INT8 post-training quantisation, a custom Triton quantisation kernel achieving 1.4x throughput over unfused PyTorch, and a full FP32 vs BF16 vs INT8 benchmark suite. 13 tests passing.
machine-learning deep-learning pytorch triton int8 distributed-training efficient-inference mixed-precision mlops gpt2 quantisation bf16 llm fsdp
-
Updated
May 23, 2026 - Python
Qwen3.6-27B BF16+DFlash 13-config parameter sweep on repne/vllm:v2. Stage A (3x3 buffer/graph) + Stage B (num_speculative_tokens) + Quality (HumanEval/MBPP). 7h, 421 problems, 195 cells.
benchmark inference parameter-sweep blackwell bf16 vllm speculative-decoding qwen3 dflash qwen-bench
-
Updated
May 11, 2026 - Shell
Add this topic to your repo
To associate your repository with the bf16 topic, visit your repo's landing page and select "manage topics."