Feature Request: Support Differential Diffusion for inpainting.

[throttlekitty]

This is a nice alternative to standard inpainting, it allows for the mask to be a gradient for control of strength on top of denoising.

https://github.com/exx8/differential-diffusion

[dfl]

this looks very cool, but apparently the code hasn’t been released yet.

[throttlekitty]

True, but it's laid out quite neatly in the paper. I just don't have the chops yet to implement it.

[throttlekitty]

They've now released their code!
Since the time of my post, I learned of a PR that had been sitting on the automatic1111 repo to perform the same task, I don't know how it compares. AUTOMATIC1111/stable-diffusion-webui#14208

[AlexD81]

I suppose, it works as denoise strength map , isn't it?
My guess is to use it with "set latent noise mask" but result is not what's expected.
This is with horizontal gradient, but there's no smooth transition, I see 3 discrete levels

upd. Just realised that smoothess depends on denoising steps. Sadly it won't work well with LCM etc (
Is it possible to fix it somehow to use it with few denoising steps?