Can i use qqq in llm-comprefessor?

[191220042]

Hello,i find qqq has been supportted by vllm, i wonder how can i get the qqq model

[dsikka]

Hi @191220042

For int4 compression, llmcompressor currently supports gptq and soon, awq quantization.