Skip to content

Commit db03465

Browse files
Ashish Guptagwang111
authored andcommitted
changes for blackbird - model sharding
1 parent c2f4102 commit db03465

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tests/unit/sagemaker/serve/builder/test_model_builder.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -2679,6 +2679,7 @@ def test_optimize_exclusive_sharding(self, mock_get_serve_setting):
26792679
ValueError,
26802680
"Sharding config is mutually exclusive and cannot be combined with any other optimization.",
26812681
lambda: model_builder.optimize(
2682+
quantization_config={"OverrideEnvironment": {"OPTION_QUANTIZE": "awq"}},
26822683
compilation_config={"OverrideEnvironment": {"OPTION_QUANTIZE": "awq"}},
26832684
sharding_config={"OverrideEnvironment": {"OPTION_QUANTIZE": "awq"}},
26842685
),

0 commit comments

Comments
 (0)