Skip to content

Commit 436846e

Browse files
authored
check (#6376)
1 parent ef316a6 commit 436846e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

fastdeploy/output/token_processor.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -232,7 +232,7 @@ def _process_batch_output_use_zmq(self, receive_datas):
232232

233233
task_id = task.request_id
234234
token_ids = stream_data.tokens # numpy.array
235-
if token_ids is not None and token_ids[-1] <= 0:
235+
if token_ids is not None and token_ids[-1] < 0:
236236
if envs.ENABLE_V1_KVCACHE_SCHEDULER:
237237
if task_id in self.resource_manager.to_be_rescheduled_request_id_set:
238238
self.resource_manager.reschedule_preempt_task(task_id)

0 commit comments

Comments
 (0)