Skip to content

Commit 64a8ea9

Browse files
fix schemes
Signed-off-by: Brian Dellabetta <[email protected]>
1 parent 6fc1fe5 commit 64a8ea9

File tree

2 files changed

+2
-13
lines changed

2 files changed

+2
-13
lines changed

tests/e2e/vLLM/recipes/WNA16/recipe_w4a16_awq_sym.yaml

Lines changed: 1 addition & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,4 @@ quant_stage:
22
quant_modifiers:
33
AWQModifier:
44
ignore: ["lm_head"]
5-
config_groups:
6-
group_0:
7-
weights:
8-
num_bits: 4
9-
type: "int"
10-
symmetric: true
11-
strategy: "group"
12-
group_size: 128
13-
targets: ["Linear"]
5+
scheme: W4A16

tests/e2e/vLLM/recipes/WNA16/recipe_w4a16_group_quant_asym_awq.yaml

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,4 @@ quant_stage:
22
quant_modifiers:
33
AWQModifier:
44
ignore: [lm_head]
5-
config_groups:
6-
group_0:
7-
weights: {num_bits: 4, type: int, symmetric: false, strategy: "group", group_size: 128}
8-
targets: [Linear]
5+
scheme: W4A16_ASYM

0 commit comments

Comments
 (0)