fix marigold ut case fail on xpu#12350

DN6 merged 3 commits intohuggingface:mainhuggingface/diffusers:mainfrom

yao-matrix:issue-525yao-matrix/diffusers:issue-525Copy head branch name to clipboard