Fix group offloading with block_level and use_stream=True#11375

a-r-r-o-w merged 4 commits intomainhuggingface/diffusers:mainfrom

fix-block-level-stream-offloadinghuggingface/diffusers:fix-block-level-stream-offloadingCopy head branch name to clipboard