Advanced quantization toolkit for LLMs and VLMs. Native support for WOQ, MXFP4, NVFP4, GGUF, Adaptive Bits and seamless integration with Transformers, vLLM, SGLang, and TorchAO
-
Updated
Dec 2, 2025 - Python
#
nvfp4
Here are 2 public repositories matching this topic...
ARCQuant: Boosting Fine-Grained Quantization with Augmented Residual Channels for LLMs
-
Updated
Nov 29, 2025 - Cuda
Improve this page
Add a description, image, and links to the nvfp4 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the nvfp4 topic, visit your repo's landing page and select "manage topics."