Skip to content

Commit c3153fe

Browse files
committed
fix eval
Signed-off-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
1 parent 5d37f12 commit c3153fe

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

tensorrt_llm/commands/eval.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -136,6 +136,10 @@ def main(ctx, model: str, tokenizer: Optional[str], log_level: str,
136136
"trust_remote_code": trust_remote_code,
137137
"revision": revision,
138138
"build_config": build_config,
139+
"max_batch_size": max_batch_size,
140+
"max_num_tokens": max_num_tokens,
141+
"max_beam_width": max_beam_width,
142+
"max_seq_len": max_seq_len,
139143
"kv_cache_config": kv_cache_config,
140144
}
141145

0 commit comments

Comments
 (0)