[tests] Unify compilation + offloading tests in quantization#11910

sayakpaul merged 5 commits intomainhuggingface/diffusers:mainfrom

quant-compile-tests-unifyhuggingface/diffusers:quant-compile-tests-unifyCopy head branch name to clipboard