Skip to content

[Model][BugFix] Mamba/Jamba exceed mamba cache slots#11414

Closed
mzusman wants to merge 3 commits intovllm-project:mainfrom
mzusman:max_batch_size_jamba_fix
Closed

[Model][BugFix] Mamba/Jamba exceed mamba cache slots#11414
mzusman wants to merge 3 commits intovllm-project:mainfrom
mzusman:max_batch_size_jamba_fix

Commits

Commits on Dec 22, 2024