Skip to content

Commit 59313ed

Browse files
authored
[XPU] fix VL thinking mode (#4266)
1 parent aa1cc09 commit 59313ed

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

fastdeploy/worker/xpu_model_runner.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1161,8 +1161,8 @@ class at the server level, which is too granular for ModelRunner.
11611161
accept_num=None,
11621162
enable_thinking=(self.share_inputs["enable_thinking"] if self.enable_mm else None),
11631163
think_end_id=(self.model_config.think_end_id if self.enable_mm else -1),
1164-
need_think_end=(self.share_inputs["need_think_end"][:num_running_requests] if self.enable_mm else None),
1165-
reasoning_index=(self.share_inputs["reasoning_index"][:num_running_requests] if self.enable_mm else None),
1164+
need_think_end=(self.share_inputs["need_think_end"] if self.enable_mm else None),
1165+
reasoning_index=(self.share_inputs["reasoning_index"] if self.enable_mm else None),
11661166
stop_token_ids=self.share_inputs["stop_seqs"],
11671167
stop_seqs_len=self.share_inputs["stop_seqs_len"],
11681168
)

0 commit comments

Comments
 (0)