Question about the motion adapter in DreamVideo

[Alisaleelee]

hi, thx for your nice work. I have some questions about DreamVideo.

Why selecting a random image embedding from the input video can diminish the impact of appearance to motion learning.

thanks.

[weilllllls]

Hi, thanks for your interest. Appearance guidance prevents the model from taking shortcuts (in learning appearance/background) by actively providing prior appearance information of motion videos, enabling the model to focus on motion learning.