Skip to content

✨[Feature] Is there a plan to support to convert quantized PT2 to trt ? #3471

Open
@MaltoseFlower

Description

@MaltoseFlower

when i use torch-tensorrt 2.4.0 to convert a quantized PT2 to trt, i got this error blow.

Image

I wonder whether it will support in ther future? Or, i am able to do this based on the current version (maybe through converting the torch.ops.quantized_decomposed.dequantize_per_tensor.default operator to other quantization operator? ).

Metadata

Metadata

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions