[Feature]: Add option to link against static TRT/nvinfer

[WilliamTambellini]

🚀 The feature, motivation and pitch

As of today, TRTLLM search for TRT (nvinfer) in the main cmake script:

TensorRT-LLM/cpp/CMakeLists.txt

Line 230 in a0e1604

find_package(TensorRT 10 REQUIRED COMPONENTS OnnxParser)

using this cmake find script:

TensorRT-LLM/cpp/cmake/modules/FindTensorRT.cmake

Line 70 in a0e1604

find_library(

TRT static libs are available for long at least on Linux:

$ ll TensorRT-10.13.3.9/lib/lib*.a
-rw-r--r-- 1 wtambellini wtambellini     786164 Aug 23 21:28 TensorRT-10.13.3.9/lib/libnvinfer_dispatch_static.a
-rw-r--r-- 1 wtambellini wtambellini 1116797272 Aug 23 21:28 TensorRT-10.13.3.9/lib/libnvinfer_lean_static.a
-rw-r--r-- 1 wtambellini wtambellini   66965756 Aug 23 21:48 TensorRT-10.13.3.9/lib/libnvinfer_plugin_static.a
-rw-r--r-- 1 wtambellini wtambellini 5329757392 Aug 23 21:48 TensorRT-10.13.3.9/lib/libnvinfer_static.a
-rw-r--r-- 1 wtambellini wtambellini     360828 Aug 23 21:48 TensorRT-10.13.3.9/lib/libnvinfer_vc_plugin_static.a
-rw-r--r-- 1 wtambellini wtambellini   14287632 Aug 23 21:16 TensorRT-10.13.3.9/lib/libnvonnxparser_static.a
lrwxrwxrwx 1 wtambellini wtambellini         26 Aug 23 21:48 TensorRT-10.13.3.9/lib/libonnx_proto.a -> ./libnvonnxparser_static.a

Woud you mind if I add a cmake option to link with static TRT/nvinfer?
Best
WT

Alternatives

No response

Additional context

No response

Before submitting a new issue...

• Make sure you already searched for relevant issues, and checked the documentation and examples for answers to frequently asked questions.

[WilliamTambellini]

@tongyuantongyu RFC please

[tongyuantongyu]

Do you need this feature or just think it's a good-to-have? As you can see, we are gradually moving to PyTorch-based, so it may not worth your effort to implement this if there's no actual need.

[WilliamTambellini]

That feature would 1 simplify our deployment, 2 secure further our on-prem deployment (against "bin planting") 3 reduce the size of our final package.
We know you are moving to the pytorch-based backend but short term (Sept 2025), we are going to deploy with the TRT backend.
I m ok to work on a PR, this should be straightforward.
Refs:
https://www.rws.com/language-weaver/edge/
https://learn.microsoft.com/en-us/windows/win32/dlls/dynamic-link-library-security
Best
Note: the log ticket is more important to us (#7350).

[tongyuantongyu]

@WilliamTambellini I see. Please go ahead.

[WilliamTambellini]

on it, tks.

[WilliamTambellini]

#7914

[karljang]

@WilliamTambellini ,
Just a quick reminder, there’s a comment on PR #7914 requesting changes~

[WilliamTambellini]

Hi @karljang tks, I would prefer to finish the logging issue first. TBC.

[github-actions]

Issue has not received an update in over 14 days. Adding stale label.