Skip to content

Commit cd49095

Browse files
committed
unconditionally add cp to device mesh
$ pytest tests/integration/defs/examples/test_ray.py::test_llm_inference_distributed_ray -s -v Signed-off-by: Balaram Buddharaju <[email protected]>
1 parent edde143 commit cd49095

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

tensorrt_llm/_torch/device_mesh.py

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -130,9 +130,8 @@ def build_mesh(self):
130130
dims += ["tp"]
131131
shape += [self.tp_size]
132132

133-
if self.cp_size > 1:
134-
dims += ["cp"]
135-
shape += [self.cp_size]
133+
dims += ["cp"]
134+
shape += [self.cp_size]
136135

137136
cls.device_mesh = init_device_mesh(
138137
"cuda",

0 commit comments

Comments
 (0)