Skip to content

Commit be20949

Browse files
authored
[None][fix] Fallback to NCCL instead of NCCL symmetric (#11174)
Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
1 parent 7f9565a commit be20949

File tree

2 files changed

+234
-96
lines changed

2 files changed

+234
-96
lines changed

cpp/tensorrt_llm/common/customAllReduceUtils.h

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -153,7 +153,7 @@ inline AllReduceStrategyType selectStrategyLookUpTable(
153153
|| num_token_index
154154
>= AllReduceBestStrategyTable.at(sm_version).at(tp_index).at(fusion_op_index).at(hidden_size_index).size())
155155
{
156-
return AllReduceStrategyType::NCCL_SYMMETRIC;
156+
return AllReduceStrategyType::NCCL;
157157
}
158158

159159
return static_cast<AllReduceStrategyType>(

0 commit comments

Comments
 (0)