Skip to content

Commit 92f86a5

Browse files
[#9137][feat] Factory sharding as default (#9144)
Signed-off-by: greg-kwasniewski1 <[email protected]>
1 parent 9b0f452 commit 92f86a5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/_torch/auto_deploy/config/default.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,7 @@ transforms:
7777
detect_sharding:
7878
stage: sharding
7979
simple_shard_only: false
80-
sharding_source: ['heuristic']
80+
sharding_source: ['factory','heuristic']
8181
support_partial_config: true
8282
sharding_dims: ['tp', 'ep', 'bmm']
8383
requires_shape_prop: true

0 commit comments

Comments
 (0)