[Feature]: AutoDeploy: investigate+optimize comm collectives in TEP mode #11068
Closed as duplicate of#10857
Description
🚀 The feature, motivation and pitch
Currently, we have one all_reduce in TEP mode (TP for attention, TP+EP in MoE). Let's investigate current optimal configuration in PT manual backend to better understand if our TEP performance is en par with current PT backend
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.
Metadata
Metadata
Assignees
Labels
Type
Projects
Status