Skip to content
This repository was archived by the owner on Sep 4, 2025. It is now read-only.

Commit 91f4522

Browse files
[multi-step] Raise error if not using async engine (vllm-project#7703)
1 parent 1b32e02 commit 91f4522

File tree

1 file changed

+5
-0
lines changed

1 file changed

+5
-0
lines changed

vllm/engine/llm_engine.py

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1302,6 +1302,11 @@ def step(self) -> List[Union[RequestOutput, EmbeddingRequestOutput]]:
13021302
raise NotImplementedError(
13031303
"Pipeline parallelism is only supported through AsyncLLMEngine "
13041304
"as performance will be severely degraded otherwise.")
1305+
1306+
if self.scheduler_config.num_scheduler_steps > 1:
1307+
raise NotImplementedError(
1308+
"Multiple scheduler steps (multi-step) are only supported "
1309+
"through AsyncLLMEngine. ")
13051310
seq_group_metadata_list, scheduler_outputs = self.scheduler[
13061311
0].schedule()
13071312

0 commit comments

Comments
 (0)