Skip to content

Commit 5552a67

Browse files
committed
[Quickfix] update CachedRequestState as NewRequestData changed
Signed-off-by: MengqingCao <[email protected]>
1 parent 103654c commit 5552a67

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -479,7 +479,7 @@ def _update_states(self, scheduler_output: "SchedulerOutput") -> None:
479479
self.requests[req_id] = CachedRequestState(
480480
req_id=req_id,
481481
prompt_token_ids=new_req_data.prompt_token_ids,
482-
mm_inputs=new_req_data.mm_inputs,
482+
mm_kwargs=new_req_data.mm_kwargs,
483483
mm_positions=new_req_data.mm_positions,
484484
sampling_params=sampling_params,
485485
pooling_params=new_req_data.pooling_params,

vllm_ascend/worker/npu_input_batch.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,7 +43,7 @@ class CachedRequestState:
4343

4444
req_id: str
4545
prompt_token_ids: list[int]
46-
mm_inputs: list[MultiModalKwargs]
46+
mm_kwargs: list[MultiModalKwargs]
4747
mm_positions: list[PlaceholderRange]
4848
sampling_params: Optional[SamplingParams]
4949
pooling_params: Optional[PoolingParams]

0 commit comments

Comments
 (0)