Skip to content

Commit 08461ec

Browse files
committed
updated ov llama config file
1 parent 41ac36a commit 08461ec

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

examples/openvino/llama/llama3_2_ov_4wo_config.yaml renamed to examples/openvino/llama/llama3_2_ov_4wo.yaml

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,11 +6,9 @@ model:
66
dtype_override: fp32
77
enable_dynamic_shape: False
88

9-
export:
10-
output_dir: "../"
11-
129
quantization:
1310
pt2e_quantize: "openvino_4wo"
11+
group_size: 128
1412

1513
backend:
1614
openvino:

0 commit comments

Comments
 (0)