Skip to content

Commit 5f0b30f

Browse files
support logprob in scheduler v1 (#3249)
Co-authored-by: Jiang-Jia-Jun <[email protected]>
1 parent 6037dd5 commit 5f0b30f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

fastdeploy/output/token_processor.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -383,6 +383,7 @@ def _process_sampling_with_logprob_batch_output(self):
383383
self.tokens_counter[task_id] += 1
384384
if token_id != RECOVERY_STOP_SIGNAL:
385385
result.outputs.token_ids.append(token_id)
386+
task.output_token_ids.append(token_id)
386387
result.outputs.logprob = float(scores[i, 0])
387388
# Construct top_logprobs
388389
topk_token_ids = tokens[i, :].tolist()

0 commit comments

Comments
 (0)