Skip to content

[Disagg][Perf] Use NPU event sync instead of blocking tolist to avoid unintentional copy ops blocking across different NPU streams, improving disagg TTIT/TTFT#3209

Open
jesse996 wants to merge 16 commits intovllm-project:mainfrom
jesse996:event-sync
Open

[Disagg][Perf] Use NPU event sync instead of blocking tolist to avoid unintentional copy ops blocking across different NPU streams, improving disagg TTIT/TTFT#3209
jesse996 wants to merge 16 commits intovllm-project:mainfrom
jesse996:event-sync

Commits

Commits on Sep 5, 2025

Commits on Sep 6, 2025

Commits on Sep 7, 2025

Commits on Sep 11, 2025

Commits on Sep 15, 2025

Commits on Sep 16, 2025

Commits on Sep 22, 2025