Skip to content

Commit a1b4ba9

Browse files
committed
add config
1 parent c8b347f commit a1b4ba9

File tree

1 file changed

+29
-0
lines changed

1 file changed

+29
-0
lines changed
Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,29 @@
1+
base:
2+
seed: &seed 42
3+
model:
4+
type: model_type
5+
path: model path
6+
torch_dtype: auto
7+
eval:
8+
eval_pos: [pretrain, fake_quant]
9+
type: img_txt
10+
name: MME
11+
download: False
12+
path: MME dataset path
13+
bs: 16
14+
inference_per_block: False
15+
quant:
16+
method: RTN
17+
quant_objects: [vision, language] # default is [language]
18+
weight:
19+
bit: 8
20+
symmetric: True
21+
granularity: per_channel
22+
group_size: -1
23+
act:
24+
bit: 8
25+
symmetric: True
26+
granularity: per_token
27+
save:
28+
save_fake: False
29+
save_path: /path/to/save/

0 commit comments

Comments
 (0)