Commit 4dce0ea
committed
test_mla_helix: Skip cp_size > 1 tests that require helix alltoall
The alltoall_helix C++ operation requires NCCL process groups to be
fully initialized via init_pg, which depends on Ray infrastructure
(TorchDist). The MPI-based test environment cannot properly set up
these NCCL groups.
For now, skip tests with cp_size > 1 which require helix communication.
Only pure TP configurations (cp_size=1) will run in the MPI environment.1 parent 93f9992 commit 4dce0ea
1 file changed
+7
-0
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1143 | 1143 | | |
1144 | 1144 | | |
1145 | 1145 | | |
| 1146 | + | |
| 1147 | + | |
| 1148 | + | |
| 1149 | + | |
| 1150 | + | |
| 1151 | + | |
| 1152 | + | |
1146 | 1153 | | |
1147 | 1154 | | |
1148 | 1155 | | |
| |||
0 commit comments