Fix offload tests for CogVideoX and CogView3#10547

DN6 merged 2 commits intomainhuggingface/diffusers:mainfrom

tests/fix-disk-offload-coghuggingface/diffusers:tests/fix-disk-offload-cogCopy head branch name to clipboard