Skip to content

Commit bfa877a

Browse files
authored
Fix: fix autodeploy (NVIDIA#4957)
Signed-off-by: QI JUN <[email protected]>
1 parent 154f7cc commit bfa877a

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/llmapi/llm_args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1086,7 +1086,7 @@ def _setup(self):
10861086
self.speculative_model
10871087
) if self.speculative_model is not None else None
10881088
if model_obj.is_local_model and self.backend not in [
1089-
'pytorch', 'autodeploy'
1089+
'pytorch', '_autodeploy'
10901090
]:
10911091
# Load parallel_config from the engine.
10921092
self.model_format = get_model_format(self.model)

0 commit comments

Comments
 (0)