handle offload_state_dict when initing transformers models#12438

sayakpaul merged 2 commits intomainhuggingface/diffusers:mainfrom

fix-transformers-model-inithuggingface/diffusers:fix-transformers-model-initCopy head branch name to clipboard