depth does not work in Text & RGBD-to-Trajectory generation?

[Shengnan-Zhu]

Hi, @kszpxxzmc, in the Text & RGBD-to-Trajectory generation (official example), the depth value does not affect the final generated trajectory. For example, multiply the value of depth by 10, but it seems that the length and scale of the generated trajectory does not change significantly. I'm not sure if I got any mistake, here is my running log：log.txt

[kszpxxzmc]

This might be because the model has never encountered such large variations in depth during training, causing the input to fall outside the domain of the data it was trained on (i.e., out-of-domain data).

[Shengnan-Zhu]

This might be because the model has never encountered such large variations in depth during training, causing the input to fall outside the domain of the data it was trained on (i.e., out-of-domain data).

So if I want to use a custom image and depth(like UnidepthV2), maybe need to rescale the depth value to a small range(e.g. 0~1) first?