Fix distributed weight loading in multi-node training#572

Edenzzzz wants to merge 3 commits intomainhao-ai-lab/FastVideo:mainfrom

revert-571-will/revert_distributed_loadhao-ai-lab/FastVideo:revert-571-will/revert_distributed_loadCopy head branch name to clipboard