support `hf_quantizer` in cache warmup.#12043

sayakpaul merged 9 commits intomainhuggingface/diffusers:mainfrom

respect-hf-quantizer-cache-warmuphuggingface/diffusers:respect-hf-quantizer-cache-warmupCopy head branch name to clipboard