TensorRT

[liuYYYYYYYYy]

What should I do after generating the TensorRT model?

[voldemortX]

@liuYYYYYYYYy You can use it in NVIDIA's related packages. I believe there is pip inference toolkits like tensorrt. See https://developer.nvidia.com/tensorrt for introductions.

[liuYYYYYYYYy]

Is there no code in this project that can run TensorRT model？

[voldemortX]

@liuYYYYYYYYy Currently we only provide conversion codes. However, we do have some verification codes that does inference here. You could use it similarly like here.

In the future, we might want to provide onnx/tensorrt execution for full dataset/custom input inference or visualization processes.

[Rsweater]

Hi @voldemortX Seniors! Is the FPS of the model in the repository, using TensorRT?

[voldemortX]

@Rsweater Not yet, lots of them have conversion issues and I feel like it should be done on a jetson, which I don't have.

[Rsweater]

@Rsweater Not yet, lots of them have conversion issues and I feel like it should be done on a jetson, which I don't have.

Oh, I see. Thank you very much, senior.