[train_dreambooth_lora.py] Fix the LR Schedulers when `num_train_epochs` is passed in a distributed training env#10973

sayakpaul merged 4 commits intohuggingface:mainhuggingface/diffusers:mainfrom

flyxiv:flyxiv-fix-lr-schedule-train-dreambooth-loraflyxiv/diffusers:flyxiv-fix-lr-schedule-train-dreambooth-loraCopy head branch name to clipboard