We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
739648f
Implement Q8_0 quantization fully in PyTorch. This is equivalent to gguf.quantize_q8_0 but doesn't round-trip to Numpy.
