Skip to content

Commit 0f75bba

Browse files
committed
allow groundtruth mismatch in AcceptanceRateValidation
Signed-off-by: Ye Yu <[email protected]>
1 parent 7390687 commit 0f75bba

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

modelopt/torch/speculative/utils.py

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -330,7 +330,9 @@ def validate(
330330

331331
if ground_truth is None:
332332
ground_truth = self.get_ground_truth(input_ids, osl)
333-
ground_truth = self.check_data_consistency_across_ranks(ground_truth)
333+
ground_truth = self.check_data_consistency_across_ranks(
334+
ground_truth, fail_when_mismatch=False
335+
)
334336

335337
cnt = 0
336338
draft_tokens = None

0 commit comments

Comments
 (0)