Skip to content

Commit ee43fc7

Browse files
nikita-savelyevvmvafin
authored andcommitted
Add a note (#1416)
1 parent a5c108b commit ee43fc7

File tree

2 files changed

+5
-1
lines changed

2 files changed

+5
-1
lines changed

docs/source/openvino/export.mdx

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -115,7 +115,9 @@ Optional arguments:
115115
['conceptual_captions','laion/220k-GPT4Vision-captions-from-LIVIS','laion/filtered-wit']. For
116116
visual language models the dataset must be set to 'contextual'. Note: if none of the data-aware
117117
compression algorithms are selected and ratio parameter is omitted or equals 1.0, the dataset
118-
argument will not have an effect on the resulting model.
118+
argument will not have an effect on the resulting model. Note: for text generation task,
119+
datasets with English texts such as 'wikitext2','c4' or 'c4-new' usually work fine even for
120+
non-English models.
119121
--all-layers Whether embeddings and last MatMul layers should be compressed to INT4. If not provided an
120122
weight compression is applied, they are compressed to INT8.
121123
--awq Whether to apply AWQ algorithm. AWQ improves generation quality of INT4-compressed LLMs. If

optimum/commands/export/openvino.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -176,6 +176,8 @@ def parse_args_openvino(parser: "ArgumentParser"):
176176
"For visual language models the dataset must be set to 'contextual'. "
177177
"Note: if none of the data-aware compression algorithms are selected and ratio parameter is omitted or "
178178
"equals 1.0, the dataset argument will not have an effect on the resulting model."
179+
"Note: for text generation task, datasets with English texts such as 'wikitext2','c4' or 'c4-new' usually "
180+
"work fine even for non-English models."
179181
),
180182
)
181183
optional_group.add_argument(

0 commit comments

Comments
 (0)