Skip to content

[Mamba] Support TP>1 with quantization for mamba2 mixer in case n_groups % tp_size == 0#24593

Merged
tdoublep merged 6 commits intovllm-project:mainfrom
tomeras91:fix-mamba2-quant-tp
Sep 16, 2025
Merged

[Mamba] Support TP>1 with quantization for mamba2 mixer in case `n_groups % tp_size == 0`#24593
tdoublep merged 6 commits intovllm-project:mainfrom
tomeras91:fix-mamba2-quant-tp

Commits

Commits on Sep 10, 2025

Commits on Sep 14, 2025

Commits on Sep 16, 2025