Skip to content

Commit 6312ea4

Browse files
committed
Update sub-module commit (#827)
* Update sub-module commit * Install libnvshmem3-cuda-13 to the base conatiner. * Preload: libnvshmem_host.so * Moving changes to the right place in Dockerfile.
1 parent 51968c6 commit 6312ea4

File tree

2 files changed

+4
-1
lines changed

2 files changed

+4
-1
lines changed

dockerfile/Dockerfile.triton.trt_llm_backend

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -160,6 +160,9 @@ RUN [ "$(uname -m)" != "x86_64" ] && arch="sbsa" || arch="x86_64" \
160160
cuda-nvrtc-dev-${NVRTC_CUDA_VERSION}=${NVRTC_VER} \
161161
libnccl2=${NCCL_VER} \
162162
libnccl-dev=${NCCL_VER} \
163+
libnvshmem3-cuda-13 \
164+
&& dpkg -L libnvshmem3-cuda-13 | grep libnvshmem_host.so | sed -e 's/libnvshmem_host.*//g' | sort -u > /etc/ld.so.conf.d/libnvshmem3-cuda-13.conf \
165+
&& ldconfig \
163166
&& rm -rf /var/lib/apt/lists/*
164167

165168
# Install TRT

tensorrt_llm

Submodule tensorrt_llm updated 4889 files

0 commit comments

Comments
 (0)