Although ControlNet pipeline has been officially supported in diffusers, there is no tutorial about how to train a ControlNet from scratch in diffusers, especially when we need to use a different kind of input as control hint. Here, we show you how to build your ControlNet.
Code coming soon! Stay tuned.