SD3ControlNet

[ZonglinL]

Describe the bug

line 1333 of examples/train_conrolnet_sd3.py
controlnet_image = controlnet_image * vae.config.scaling_factor
missing shift factor

should be controlnet_image = (controlnet_image - vae.config.shift_factor) * vae.config.scaling_factor

Reproduction

controlnet_image = (controlnet_image - vae.config.shift_factor) * vae.config.scaling_factor

Logs

System Info

I check on 0.35.0dev, and I think it should exists for all older version.

Who can help?

No response

[asomoza]

closing this as a duplicate of #11867 which is being fixed in this PR