[feat] cache allocator warmup for `from_single_model`#12305

sayakpaul merged 4 commits intomainhuggingface/diffusers:mainfrom

single-file-cache-allocatorhuggingface/diffusers:single-file-cache-allocatorCopy head branch name to clipboard