Skip to content

Commit 3410508

Browse files
authored
cache_transceiver_config (NVIDIA#4556)
Signed-off-by: Chuang Zhu <111838961+chuangz0@users.noreply.github.com>
1 parent e741d2b commit 3410508

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/llmapi/llm.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -609,7 +609,7 @@ def _build_model(self):
609609
if self._on_trt_backend and self.args.extended_runtime_perf_knob_config is not None:
610610
executor_config.extended_runtime_perf_knob_config = PybindMirror.maybe_to_pybind(
611611
self.args.extended_runtime_perf_knob_config)
612-
if self._on_trt_backend and self.args.cache_transceiver_config is not None:
612+
if self.args.cache_transceiver_config is not None:
613613
executor_config.cache_transceiver_config = PybindMirror.maybe_to_pybind(
614614
self.args.cache_transceiver_config)
615615
from tensorrt_llm._torch.pyexecutor.config import update_executor_config

0 commit comments

Comments
 (0)