[CORE] [QUANT] Support for GPTQModel's dynamic quantization per module override/control
#25420
Annotations
7 errors and 1 warning
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L76
Incompatible types in assignment (expression has type "Union[dict[Any, Any], int]", variable has type "int") [assignment]
|
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L77
Incompatible types in assignment (expression has type "Union[dict[Any, Any], int]", variable has type "int") [assignment]
|
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L78
Incompatible types in assignment (expression has type "Union[dict[Any, Any], int]", variable has type "bool") [assignment]
|
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L79
Incompatible types in assignment (expression has type "Union[dict[Any, Any], int]", variable has type "bool") [assignment]
|
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L144
Incompatible default for argument "key" (default has type "None", argument has type "str") [assignment]
|
|
Mypy:
vllm/model_executor/layers/quantization/gptq_marlin.py#L144
Incompatible default for argument "default_value" (default has type "None", argument has type "Union[int, bool]") [assignment]
|
|
Mypy
Process completed with exit code 1.
|
|
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
|
Loading