[LoRA] Handle DoRA better#9547

sayakpaul merged 14 commits intomainhuggingface/diffusers:mainfrom

handle-dorahuggingface/diffusers:handle-doraCopy head branch name to clipboard