List view

Remove MoE throughput test

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2075

#2075 In NVIDIA/Megatron-LM;

· mathemakitten opened on Oct 31, 2025

[Dev] Changes to support multimodule pipelining

dev branchDev branch related issues and developmentDev branch related issues and development

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2092

#2092 In NVIDIA/Megatron-LM;

· yashaswikarnati opened on Nov 3, 2025

feat(moe): Support placing MTP layers into standalone stages

complexity: high

dev2maindev to main: this PR is needed in maindev to main: this PR is needed in main

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2136

#2136 In NVIDIA/Megatron-LM;

· BestJuly opened on Nov 5, 2025

nonuniform tensor parallelism

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2149

#2149 In NVIDIA/Megatron-LM;

· daiyaanarfeen opened on Nov 5, 2025

[Dev] test(MoE): Add performance test for MoE layer

dev branchDev branch related issues and developmentDev branch related issues and development

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2177

#2177 In NVIDIA/Megatron-LM;

· Victarry opened on Nov 7, 2025

[Draft] Remove calculation of padding token in moe routing loss

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Run functional tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2142

#2142 In NVIDIA/Megatron-LM;

· HaochenYuan opened on Nov 5, 2025

Super tiny fix typo

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2215

#2215 In NVIDIA/Megatron-LM;

· fzyzcjy opened on Nov 12, 2025

[main] feat(moe): Support gated delta net for Qwen3-Next (1/4)

complexity: high

dev2maindev to main: this PR is needed in maindev to main: this PR is needed in main

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 1989

#1989 In NVIDIA/Megatron-LM;

· yuzhongw-nvidia opened on Oct 28, 2025

feat(moe): Fine-grained activation offloading

complexity: high

dev2maindev to main: this PR is needed in maindev to main: this PR is needed in main

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 1913

#1913 In NVIDIA/Megatron-LM;

· lhb8125 opened on Oct 24, 2025

feat: enhance one_logger_utils to support rankpulse integration

community-request

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 1988

#1988 In NVIDIA/Megatron-LM;

· sanshang-nv opened on Oct 28, 2025

Hybrid Context Parallel Feature

complexity: high

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2282

#2282 In NVIDIA/Megatron-LM;

· parthmannan opened on Nov 17, 2025

Support multimodule communication

Run tests

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2031

#2031 In NVIDIA/Megatron-LM;

· yaoyu-33 opened on Oct 29, 2025

[MoE] Improvement of shared expert overlap, support shared expert overlap for FlexDispatcher

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2207

#2207 In NVIDIA/Megatron-LM;

· Victarry opened on Nov 11, 2025

[training migration] add RNG config dataclass

complexity: low

enhancementNew feature or requestNew feature or request

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

module: training

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2347

#2347 In NVIDIA/Megatron-LM;

· maanug-nv opened on Nov 21, 2025

[Dev] docs(megatron-fsdp): add Megatron-FSDP user guide

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2397

#2397 In NVIDIA/Megatron-LM;

· xuwchen opened on Nov 25, 2025

feat: Apply RoPE embedding with sequence offsets

complexity: low

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2416

#2416 In NVIDIA/Megatron-LM;

· sudhakarsingh27 opened on Nov 26, 2025

Test workflow

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2432

#2432 In NVIDIA/Megatron-LM;

· chtruong814 opened on Nov 30, 2025

Support CUDA Graph capture offloading modules

dev branchDev branch related issues and developmentDev branch related issues and development

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2437

#2437 In NVIDIA/Megatron-LM;

· lhb8125 opened on Dec 1, 2025

Add a UT for the entire training loop

Status: Draft (not ready).

NVIDIA/Megatron-LMnumber 2409

#2409 In NVIDIA/Megatron-LM;

· yuzhongw-nvidia opened on Nov 26, 2025

[Dev] feat: hybrid-cp for dev branch (part 2)

dev branchDev branch related issues and developmentDev branch related issues and development

enhancementNew feature or requestNew feature or request

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2000

#2000 In NVIDIA/Megatron-LM;

· xiaoyao0115 opened on Oct 28, 2025

[Main] Partial CUDA Graph support for EP Overlap

complexity: high

dev2maindev to main: this PR is needed in maindev to main: this PR is needed in main

Expert ReviewApply this label to indicate that your PR is ready for expert review.Apply this label to indicate that your PR is ready for expert review.

module: moe

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2184

#2184 In NVIDIA/Megatron-LM;

· Wohox opened on Nov 10, 2025

fix(moe): Support HybridEP and reduce memory overhead for 1F1B A2A overlap

complexity: medium

dev2maindev to main: this PR is needed in maindev to main: this PR is needed in main

Final ReviewApply this label to indicate that your PR is ready for final review.Apply this label to indicate that your PR is ready for final review.

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2236

#2236 In NVIDIA/Megatron-LM;

· lhb8125 opened on Nov 13, 2025

Enable training cudagraphs for RL

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2452

#2452 In NVIDIA/Megatron-LM;

· mathemakitten opened on Dec 2, 2025

build: Bump TE to 2.10

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2491

#2491 In NVIDIA/Megatron-LM;

· chtruong814 opened on Dec 4, 2025

Refactoring of PP implementation for hybrid models to support virtual pipeline parallelism

Status: Open (in progress).

NVIDIA/Megatron-LMnumber 2492

#2492 In NVIDIA/Megatron-LM;

· deepakn94 opened on Dec 4, 2025