[examples/controlnet/train_controlnet_sd3.py] training SD3.5 large controlnets from stability

[andjoer]

It is currently not possible to fine-tune controlnets for SD3.5 large from stability ai like stabilityai/stable-diffusion-3.5-large-controlnet-blur due to the handling of positional embeddings.

I have extended and testet the script accordingly since I need it for my use case. Would this be interesting and should I do a PR?

@sayakpaul

[sayakpaul]

Oh thanks much. Let’s do the PR!

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.