Skip to content

Commit 2c59014

Browse files
committed
[Test Fix][From Leslie Fang] fix test_disaggregated_deepseek_v3_lite_fp8_mpi[DeepSeek-V3-Lite-fp8]
Signed-off-by: ZhanruiSunCh <184402041+ZhanruiSunCh@users.noreply.github.com>
1 parent b573920 commit 2c59014

File tree

1 file changed

+5
-2
lines changed

1 file changed

+5
-2
lines changed

docker/common/install_mpi4py.sh

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -27,12 +27,15 @@ diff --git a/src/mpi4py/futures/_lib.py b/src/mpi4py/futures/_lib.py
2727
index f14934d1..eebfb8fc 100644
2828
--- a/src/mpi4py/futures/_lib.py
2929
+++ b/src/mpi4py/futures/_lib.py
30-
@@ -278,6 +278,40 @@ def _manager_comm(pool, options, comm, full=True):
30+
@@ -278,6 +278,43 @@ def _manager_comm(pool, options, comm, full=True):
3131
3232
3333
def _manager_split(pool, options, comm, root):
3434
+ if(os.getenv("TRTLLM_USE_MPI_KVCACHE")=="1"):
35-
+ from cuda import cudart
35+
+ try:
36+
+ from cuda.bindings import runtime as cudart
37+
+ except ImportError:
38+
+ from cuda import cudart
3639
+ has_slurm_rank=False
3740
+ has_ompi_rank=False
3841
+ slurm_rank=0

0 commit comments

Comments
 (0)