the ControlNet is not working

Hello! I trained the VAE and LDM well using your codes, and I have examined the results. However, for ControlNet, I found that my results still normal LDM results without any control. Could you please give some clues to debug my codes?