[chore] remove controlnet implementations outside controlnet module.#12152

sayakpaul wants to merge 7 commits intomainhuggingface/diffusers:mainfrom

remove-non-controlnet-moduleshuggingface/diffusers:remove-non-controlnet-modulesCopy head branch name to clipboard