Skip to content

Commit 35ec958

Browse files
Fixed missing dist backend
Signed-off-by: greg-kwasniewski1 <213329731+greg-kwasniewski1@users.noreply.github.com>
1 parent a111eb3 commit 35ec958

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tensorrt_llm/_torch/auto_deploy/utils/sharding_utils.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -764,6 +764,7 @@ def apply(self, gm: GraphModule, node: Node) -> None:
764764
rank=self.rank,
765765
world_size=self.world_size,
766766
add_dist=self.dist_op is not None,
767+
dist_backend=self.dist_backend,
767768
min_local_shape=self.min_local_shape,
768769
fused_weight_dims=self.fused_weight_dims,
769770
quantization_cb=self.quantization_cb,

0 commit comments

Comments
 (0)