Skip to content

Is there a way of running D-FINE on Jetson nano? #337

Closed
Closed
Is there a way of running D-FINE on Jetson nano?#337
@ymb943

Description

@ymb943
ymb943
opened on Nov 19, 2025

Hi. I'm trying to run D-FINE on Jetson nano.
I converted pt file into onnx file.
Then, I tried converting onnx file into engine file, resulting in the following error.
Jetson nano has low JetPack and TensorRT version, so they don't provide GridSample function.
Can someone guide how to solve this error?
Would using external plugin which implements GridSample function when I run the command for converting onnx to engine solve this issue? like /usr/src/tensorrt/bin/trtexec --onnx="dfine_n_coco_final_v2.onnx" --saveEngine="model.engine" --fp16 --plugins 'gridsample.so'

/workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx="dfine_n_coco_final_v2.onnx" --saveEngine="model.engine" --fp16
&&&& RUNNING TensorRT.trtexec [TensorRT v8201] # /workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx=dfine_n_coco_final_v2.onnx --saveEngine=model.engine --fp16
[11/16/2025-03:27:48] [I] === Model Options ===
[11/16/2025-03:27:48] [I] Format: ONNX
[11/16/2025-03:27:48] [I] Model: dfine_n_coco_final_v2.onnx
[11/16/2025-03:27:48] [I] Output:
[11/16/2025-03:27:48] [I] === Build Options ===
[11/16/2025-03:27:48] [I] Max batch: explicit batch
[11/16/2025-03:27:48] [I] Workspace: 16 MiB
[11/16/2025-03:27:48] [I] minTiming: 1
[11/16/2025-03:27:48] [I] avgTiming: 8
[11/16/2025-03:27:48] [I] Precision: FP32+FP16
[11/16/2025-03:27:48] [I] Calibration: 
[11/16/2025-03:27:48] [I] Refit: Disabled
[11/16/2025-03:27:48] [I] Sparsity: Disabled
[11/16/2025-03:27:48] [I] Safe mode: Disabled
[11/16/2025-03:27:48] [I] DirectIO mode: Disabled
[11/16/2025-03:27:48] [I] Restricted mode: Disabled
[11/16/2025-03:27:48] [I] Save engine: model.engine
[11/16/2025-03:27:48] [I] Load engine: 
[11/16/2025-03:27:48] [I] Profiling verbosity: 0
[11/16/2025-03:27:48] [I] Tactic sources: Using default tactic sources
[11/16/2025-03:27:48] [I] timingCacheMode: local
[11/16/2025-03:27:48] [I] timingCacheFile: 
[11/16/2025-03:27:48] [I] Input(s)s format: fp32:CHW
[11/16/2025-03:27:48] [I] Output(s)s format: fp32:CHW
[11/16/2025-03:27:48] [I] Input build shapes: model
[11/16/2025-03:27:48] [I] Input calibration shapes: model
[11/16/2025-03:27:48] [I] === System Options ===
[11/16/2025-03:27:48] [I] Device: 0
[11/16/2025-03:27:48] [I] DLACore: 
[11/16/2025-03:27:48] [I] Plugins:
[11/16/2025-03:27:48] [I] === Inference Options ===
[11/16/2025-03:27:48] [I] Batch: Explicit
[11/16/2025-03:27:48] [I] Input inference shapes: model
[11/16/2025-03:27:48] [I] Iterations: 10
[11/16/2025-03:27:48] [I] Duration: 3s (+ 200ms warm up)
[11/16/2025-03:27:48] [I] Sleep time: 0ms
[11/16/2025-03:27:48] [I] Idle time: 0ms
[11/16/2025-03:27:48] [I] Streams: 1
[11/16/2025-03:27:48] [I] ExposeDMA: Disabled
[11/16/2025-03:27:48] [I] Data transfers: Enabled
[11/16/2025-03:27:48] [I] Spin-wait: Disabled
[11/16/2025-03:27:48] [I] Multithreading: Disabled
[11/16/2025-03:27:48] [I] CUDA Graph: Disabled
[11/16/2025-03:27:48] [I] Separate profiling: Disabled
[11/16/2025-03:27:48] [I] Time Deserialize: Disabled
[11/16/2025-03:27:48] [I] Time Refit: Disabled
[11/16/2025-03:27:48] [I] Skip inference: Disabled
[11/16/2025-03:27:48] [I] Inputs:
[11/16/2025-03:27:48] [I] === Reporting Options ===
[11/16/2025-03:27:48] [I] Verbose: Disabled
[11/16/2025-03:27:48] [I] Averages: 10 inferences
[11/16/2025-03:27:48] [I] Percentile: 99
[11/16/2025-03:27:48] [I] Dump refittable layers:Disabled
[11/16/2025-03:27:48] [I] Dump output: Disabled
[11/16/2025-03:27:48] [I] Profile: Disabled
[11/16/2025-03:27:48] [I] Export timing to JSON file: 
[11/16/2025-03:27:48] [I] Export output to JSON file: 
[11/16/2025-03:27:48] [I] Export profile to JSON file: 
[11/16/2025-03:27:48] [I] 
[11/16/2025-03:27:48] [I] === Device Information ===
[11/16/2025-03:27:48] [I] Selected Device: NVIDIA Tegra X1
[11/16/2025-03:27:48] [I] Compute Capability: 5.3
[11/16/2025-03:27:48] [I] SMs: 1
[11/16/2025-03:27:48] [I] Compute Clock Rate: 0.9216 GHz
[11/16/2025-03:27:48] [I] Device Global Memory: 3963 MiB
[11/16/2025-03:27:48] [I] Shared Memory per SM: 64 KiB
[11/16/2025-03:27:48] [I] Memory Bus Width: 64 bits (ECC disabled)
[11/16/2025-03:27:48] [I] Memory Clock Rate: 0.01275 GHz
[11/16/2025-03:27:48] [I] 
[11/16/2025-03:27:48] [I] TensorRT version: 8.2.1
[11/16/2025-03:27:50] [I] [TRT] [MemUsageChange] Init CUDA: CPU +230, GPU +0, now: CPU 248, GPU 2578 (MiB)
[11/16/2025-03:27:51] [I] [TRT] [MemUsageSnapshot] Begin constructing builder kernel library: CPU 248 MiB, GPU 2578 MiB
[11/16/2025-03:27:51] [I] [TRT] [MemUsageSnapshot] End constructing builder kernel library: CPU 277 MiB, GPU 2608 MiB
[11/16/2025-03:27:51] [I] Start parsing network model
[11/16/2025-03:27:51] [I] [TRT] ----------------------------------------------------------------
[11/16/2025-03:27:51] [I] [TRT] Input filename:   dfine_n_coco_final_v2.onnx
[11/16/2025-03:27:51] [I] [TRT] ONNX IR version:  0.0.8
[11/16/2025-03:27:51] [I] [TRT] Opset version:    16
[11/16/2025-03:27:51] [I] [TRT] Producer name:    pytorch
[11/16/2025-03:27:51] [I] [TRT] Producer version: 2.0.1
[11/16/2025-03:27:51] [I] [TRT] Domain:           
[11/16/2025-03:27:51] [I] [TRT] Model version:    0
[11/16/2025-03:27:51] [I] [TRT] Doc string:       
[11/16/2025-03:27:51] [I] [TRT] ----------------------------------------------------------------
[11/16/2025-03:27:51] [W] [TRT] onnx2trt_utils.cpp:366: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[11/16/2025-03:27:51] [W] [TRT] onnx2trt_utils.cpp:392: One or more weights outside the range of INT32 was clamped
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:51] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:52] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/encoder/encoder.0/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[400,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] /model/decoder/decoder/layers.0/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[300,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[11/16/2025-03:27:53] [I] [TRT] No importer registered for op: GridSample. Attempting to import as plugin.
[11/16/2025-03:27:53] [I] [TRT] Searching for plugin: GridSample, plugin_version: 1, plugin_namespace: 
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:773: While parsing node number 418 [GridSample -> "/model/decoder/decoder/layers.0/cross_attn/GridSample_output_0"]:
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:774: --- Begin node ---
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:775: input: "/model/decoder/decoder/layers.0/cross_attn/Reshape_3_output_0"
input: "/model/decoder/decoder/layers.0/cross_attn/Split_output_0"
output: "/model/decoder/decoder/layers.0/cross_attn/GridSample_output_0"
name: "/model/decoder/decoder/layers.0/cross_attn/GridSample"
op_type: "GridSample"
attribute {
  name: "align_corners"
  i: 0
  type: INT
}
attribute {
  name: "mode"
  s: "bilinear"
  type: STRING
}
attribute {
  name: "padding_mode"
  s: "zeros"
  type: STRING
}

[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:776: --- End node ---
[11/16/2025-03:27:53] [E] [TRT] ModelImporter.cpp:779: ERROR: builtin_op_importers.cpp:4870 In function importFallbackPluginImporter:
[8] Assertion failed: creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[11/16/2025-03:27:53] [E] Failed to parse onnx file
[11/16/2025-03:27:53] [I] Finish parsing network model
[11/16/2025-03:27:53] [E] Parsing model failed
[11/16/2025-03:27:53] [E] Failed to create engine from model.
[11/16/2025-03:27:53] [E] Engine set up failed
&&&& FAILED TensorRT.trtexec [TensorRT v8201] # /workspace/system_root/usr/src/tensorrt/bin/trtexec --onnx=dfine_n_coco_final_v2.onnx --saveEngine=model.engine --fp16

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions