The brightness of the video is unstable

[Datou]

I tested several prompt words, and the generated video always suddenly brightened in the middle frame.

DynamiCrafter_00003.mp4

DynamiCrafter_00004.mp4

DynamiCrafter_00009.mp4

myworkflow.json

[ExponentialML]

Cool gens! This is actually the default behavior of Dynamicrafter. The original repository does this in code, but you have to do it manually here for the time being. Here are some ways to tackle the issue:

1. The way to get around this is to use a masked batch (mask at frame 1 is black, the rest are are white) with the init frame being your first frame. You can use the VAE Encode Inpainting masks for this.

2. The second way is to use the "scale_latents" option and disable / enable the rescale CFG node to get the results you want.

3. Use the interpolation model since it always has a start and an end frame. Then you can just remove the first and last frames from the result (like in the original repo).

4. I'm releasing a tool that will normalize the colors based on a reference frames, but this will be in another repository. It's what I currently use to stabilize my generations.

5. Remove it manually, although we don't want to do that 🙂 .

[Datou]

Cool gens! This is actually the default behavior of Dynamicrafter. The original repository does this in code, but you have to do it manually here for the time being. Here are some ways to tackle the issue:

1. The way to get around this is to use a masked batch (mask at frame 1 is black, the rest are are white) with the init frame being your first frame. You can use the VAE Encode Inpainting masks for this.
   I dont know how to make mask batch, could you provide an example workflow?

2. The second way is to use the "scale_latents" option and disable / enable the rescale CFG node to get the results you want.
   After turning on the scale latents option, the overall picture of the video is brightened, but there are still brighter frames in the middle.
   

3. Use the interpolation model since it always has a start and an end frame. Then you can just remove the first and last frames from the result (like in the original repo).
   The interpolation model produces weird movie motion.
   

4. I'm releasing a tool that will normalize the colors based on a reference frames, but this will be in another repository. It's what I currently use to stabilize my generations.
   Very much looking forward to it.

5. Remove it manually, although we don't want to do that 🙂 .

[cheezecrisp]

I found a simple way to solve it, add 'colormatch' node (from kjnodes) to the output.

[Datou]

I found a simple way to solve it, add 'colormatch' node (from kjnodes) to the output.

Thanks a lot!

[yorkane]

I found a simple way to solve it, add 'colormatch' node (from kjnodes) to the output.

huge thanks!