Skip to content

Commit 795fb09

Browse files
authored
Export models readme help update (openvinotoolkit#3231)
* export_models_readme_help_update * updates
1 parent 4b60f71 commit 795fb09

File tree

2 files changed

+11
-6
lines changed

2 files changed

+11
-6
lines changed

demos/common/export_models/README.md

Lines changed: 10 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -32,7 +32,7 @@ usage: export_model.py text_generation [-h]
3232
[--config_file_path CONFIG_FILE_PATH]
3333
[--overwrite_models]
3434
[--target_device TARGET_DEVICE]
35-
[--pipeline_type PIPELINE_TYPE]
35+
[--pipeline_type {LM,LM_CB,VLM,VLM_CB,AUTO}]
3636
[--kv_cache_precision {u8}]
3737
[--extra_quantization_params EXTRA_QUANTIZATION_PARAMS]
3838
[--enable_prefix_caching]
@@ -42,6 +42,7 @@ usage: export_model.py text_generation [-h]
4242
[--cache_size CACHE_SIZE]
4343
[--draft_source_model DRAFT_SOURCE_MODEL]
4444
[--draft_model_name DRAFT_MODEL_NAME]
45+
[--max_prompt_len MAX_PROMPT_LEN]
4546

4647
options:
4748
-h, --help show this help message and exit
@@ -60,10 +61,10 @@ options:
6061
--overwrite_models Overwrite the model if it already exists in the models
6162
repository
6263
--target_device TARGET_DEVICE
63-
CPU or GPU, default is CPU
64-
--pipeline_type PIPELINE_TYPE
65-
Type of the pipeline to be used. Can be either TEXT_CB
66-
or VLM_CB. When undefined, it will be autodetected
64+
CPU, GPU, NPU or HETERO, default is CPU
65+
--pipeline_type {LM,LM_CB,VLM,VLM_CB,AUTO}
66+
Type of the pipeline to be used. AUTO is used by
67+
default
6768
--kv_cache_precision {u8}
6869
u8 or empty (model default). Reduced kv cache
6970
precision to u8 lowers the cache size consumption.
@@ -94,6 +95,10 @@ options:
9495
deployment. Equal to draft_source_model if HF model
9596
name is used. Available only in draft_source_model has
9697
been specified.
98+
--max_prompt_len MAX_PROMPT_LEN
99+
Sets NPU specific property for maximum number of
100+
tokens in the prompt. Not effective if target device
101+
is not NPU
97102
```
98103

99104
## Examples how models can be exported

demos/universal-sentence-encoder/README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ chmod -R 755 universal-sentence-encoder-multilingual
1717
```
1818

1919
The model setup should look like this
20-
```console
20+
```bash
2121
tree universal-sentence-encoder-multilingual/
2222

2323
universal-sentence-encoder-multilingual/

0 commit comments

Comments
 (0)