refactor SD3, speedup tests#9169

a-r-r-o-w wants to merge 7 commits intomainhuggingface/diffusers:mainfrom

sd3/refactor-and-speedup-testshuggingface/diffusers:sd3/refactor-and-speedup-testsCopy head branch name to clipboard