Skip to content

[Feature][torch.compile] Add pass to rearrange AllGather for FP8 models in sequence parallel for better Async TP fusion#26257

Draft
jasonlizhengjian wants to merge 12 commits intovllm-project:mainfrom
jasonlizhengjian:fix/fused-scaled-matmul-signature2
Draft

[Feature][torch.compile] Add pass to rearrange AllGather for FP8 models in sequence parallel for better Async TP fusion#26257
jasonlizhengjian wants to merge 12 commits intovllm-project:mainfrom
jasonlizhengjian:fix/fused-scaled-matmul-signature2

Commits

Commits on Oct 5, 2025