File tree Expand file tree Collapse file tree 2 files changed +5
-1
lines changed Expand file tree Collapse file tree 2 files changed +5
-1
lines changed Original file line number Diff line number Diff line change @@ -115,7 +115,9 @@ Optional arguments:
115115 ['conceptual_captions','laion/220k-GPT4Vision-captions-from-LIVIS','laion/filtered-wit']. For
116116 visual language models the dataset must be set to ' contextual' . Note: if none of the data-aware
117117 compression algorithms are selected and ratio parameter is omitted or equals 1.0, the dataset
118- argument will not have an effect on the resulting model.
118+ argument will not have an effect on the resulting model. Note: for text generation task,
119+ datasets with English texts such as ' wikitext2' ,'c4' or ' c4-new' usually work fine even for
120+ non-English models.
119121 --all-layers Whether embeddings and last MatMul layers should be compressed to INT4. If not provided an
120122 weight compression is applied, they are compressed to INT8.
121123 --awq Whether to apply AWQ algorithm. AWQ improves generation quality of INT4-compressed LLMs. If
Original file line number Diff line number Diff line change @@ -176,6 +176,8 @@ def parse_args_openvino(parser: "ArgumentParser"):
176176 "For visual language models the dataset must be set to 'contextual'. "
177177 "Note: if none of the data-aware compression algorithms are selected and ratio parameter is omitted or "
178178 "equals 1.0, the dataset argument will not have an effect on the resulting model."
179+ "Note: for text generation task, datasets with English texts such as 'wikitext2','c4' or 'c4-new' usually "
180+ "work fine even for non-English models."
179181 ),
180182 )
181183 optional_group .add_argument (
You can’t perform that action at this time.
0 commit comments