Commit 4ec4001
committed
refactor: move NTP config to separate NonuniformTPConfig class
- Create NonuniformTPConfig dataclass in nonuniform_tp.py
- Remove NTP fields from DistributedDataParallelConfig (non-intrusive)
- Update all NTP functions/classes to use NonuniformTPConfig
- Update all tests to use NonuniformTPConfig
- Update CLAUDE.md documentation
This makes the NTP implementation completely self-contained with
zero modifications to core Megatron files.1 parent 3708a47 commit 4ec4001
File tree
3 files changed
+125
-96
lines changed- megatron/core/distributed
- tests/unit_tests/distributed
3 files changed
+125
-96
lines changedLines changed: 0 additions & 22 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
162 | 162 | | |
163 | 163 | | |
164 | 164 | | |
165 | | - | |
166 | | - | |
167 | | - | |
168 | | - | |
169 | | - | |
170 | | - | |
171 | | - | |
172 | | - | |
173 | | - | |
174 | | - | |
175 | | - | |
176 | | - | |
177 | | - | |
178 | | - | |
179 | | - | |
180 | | - | |
181 | | - | |
182 | | - | |
183 | | - | |
184 | | - | |
185 | | - | |
186 | | - | |
187 | 165 | | |
188 | 166 | | |
189 | 167 | | |
| |||
0 commit comments