Skip to content

Commit e57f591

Browse files
committed
add back no asnc scheduling
Signed-off-by: Brian Yu <bxyu@nvidia.com>
1 parent 06b8774 commit e57f591

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

benchmarks/nemotron_3.5_super/vllm_configs/nemotron_3.5_super.sh

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -11,6 +11,7 @@ VLLM_COMMON_ARGS=(
1111
--enable-prefix-caching
1212
--kv-cache-dtype fp8
1313
--no-disable-hybrid-kv-cache-manager
14+
--no-async-scheduling
1415
--block-size 128
1516
--mamba-cache-mode align
1617
--mamba-ssm-cache-dtype float32

0 commit comments

Comments
 (0)