Describe the bug
ControlNets are essentially copies of the diffusion model encoders. However, on the ControlNetLatentDiffusionInferer, the context (conditioning) isn't passed to the ControlNet even though the DiffusionModel might take it in. If ControlNet has been defined with conditioning, this causes an error.
To Reproduce
Steps to reproduce the behaviour:
- Create DiffusionModel and ControlNet with conditioning = True.
- Create ControlNetDiffusionInferer
- Run the call() function on the inferer passing dummy random tensors.
Expected behaviour
ControlNet should take in the conditioning tensor.