Skip to content

Commit 5328b55

Browse files
committed
allow groundtruth mismatch in AcceptanceRateValidation
Signed-off-by: Ye Yu <[email protected]>
1 parent e032a52 commit 5328b55

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

modelopt/torch/speculative/utils.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -331,7 +331,9 @@ def validate(
331331

332332
if ground_truth is None:
333333
ground_truth = self.get_ground_truth(input_ids, osl)
334-
ground_truth = self.check_data_consistency_across_ranks(ground_truth)
334+
ground_truth = self.check_data_consistency_across_ranks(
335+
ground_truth, fail_when_mismatch=False
336+
)
335337

336338
cnt = 0
337339
draft_tokens = None

0 commit comments

Comments
 (0)