Skip to content

Commit 09cca73

Browse files
authored
Add E2E test config for AWQ symmetric quantization (#1877)
Add e2e test for AWQ sym quantization, resolving this ticket: #1852 --------- Signed-off-by: WenheLI <[email protected]>
1 parent 3e721cb commit 09cca73

File tree

2 files changed

+8
-1
lines changed

2 files changed

+8
-1
lines changed

tests/e2e/vLLM/configs/w4a16_grouped_quant_asym_awq.yaml

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,5 @@ model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
44
recipe: tests/e2e/vLLM/recipes/WNA16/recipe_w4a16_group_quant_asym_awq.yaml
55
dataset_id: "mit-han-lab/pile-val-backup"
66
dataset_split: validation
7-
num_calibration_samples: 2000
87
scheme: W4A16_weight_asym_awq
98
save_dir: TinyLlama-1.1B-Chat-v1.0-w4a16-asym-awq
Lines changed: 8 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,8 @@
1+
cadence: "nightly"
2+
test_type: "regression"
3+
model: TinyLlama/TinyLlama-1.1B-Chat-v1.0
4+
recipe: tests/e2e/vLLM/recipes/WNA16/recipe_w4a16_awq_sym.yaml
5+
dataset_id: "mit-han-lab/pile-val-backup"
6+
dataset_split: validation
7+
scheme: W4A16_weight_sym_awq
8+
save_dir: TinyLlama-1.1B-Chat-v1.0-w4a16-sym-awq

0 commit comments

Comments
 (0)