Introduce all_reduce_hook to support gradient aggregation across replica groups.#7764
Open
zhengchenyu wants to merge 2 commits intodeepspeedai:masterfrom
Open
Introduce all_reduce_hook to support gradient aggregation across replica groups.#7764zhengchenyu wants to merge 2 commits intodeepspeedai:masterfrom
zhengchenyu wants to merge 2 commits intodeepspeedai:masterfrom