Skip to content

Commit cfcb97a

Browse files
authored
[BUG5388075][fix] Fix error in post-merge-tests (NVIDIA#5949)
Signed-off-by: wili-65535 <[email protected]> Co-authored-by: wili-65535 <[email protected]>
1 parent c7ffadf commit cfcb97a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/llmapi/llm_args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1433,7 +1433,7 @@ def validate_speculative_config(self):
14331433
self.build_config.max_draft_len = self.speculative_config.max_draft_len
14341434
self.build_config.speculative_decoding_mode = SpeculativeDecodingMode.EAGLE
14351435
if self.speculative_config.eagle3_one_model:
1436-
self.num_extra_kv_tokens = self.max_draft_len - 1
1436+
self.speculative_config.num_extra_kv_tokens = self.speculative_config.max_draft_len - 1
14371437
if self.backend not in ['pytorch', '_autodeploy']:
14381438
eagle_config = _EagleConfig(
14391439
self.speculative_config.eagle_choices,

0 commit comments

Comments
 (0)