Skip to content

Commit 3151792

Browse files
author
Ashwin Ramesh
authored
Updated docs for perf_analyzer flags casing and run_config_search_preferred_batch_size_disable (#224)
1 parent 04cc221 commit 3151792

File tree

2 files changed

+9
-4
lines changed

2 files changed

+9
-4
lines changed

docs/config.md

Lines changed: 7 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -630,7 +630,7 @@ profile_models:
630630
model_1:
631631
perf_analyzer_flags:
632632
percentile: 95
633-
latency_report_file: /path/to/latency/report/file
633+
latency-report-file: /path/to/latency/report/file
634634
```
635635

636636
The `perf_analyzer_flags` section can also be specified globally to affect
@@ -644,10 +644,13 @@ profile_models:
644644
batch_sizes: 4
645645
perf_analyzer_flags:
646646
percentile: 95
647-
latency_report_file: /path/to/latency/report/file
647+
latency-report-file: /path/to/latency/report/file
648648
```
649649

650-
**Important Notes**:
650+
**Important Notes**:
651+
* When providing arguments under `perf_analyzer_flags`, you must use `-` instead
652+
of `_`. This casing is important and Model Analyzer will not recognize
653+
`snake_cased` arguments.
651654
* The Model Analyzer also provides certain arguments to the `perf_analyzer`
652655
instances it launches. They are the following:
653656
* `concurrency-range`
@@ -703,7 +706,7 @@ profile_models:
703706
exit_timeout_secs: 120
704707
```
705708

706-
**Important Notes**:
709+
**Important Notes**:
707710
* The Model Analyzer also provides certain arguments to the `tritonserver`
708711
instances it launches. These ***cannot*** be overriden by providing those
709712
arguments in this section. An example of this is `http-port`, which is an

docs/config_search.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -72,6 +72,8 @@ profile_models:
7272

7373
If either `concurrency` or `model_config_parameters` is specified for one of the
7474
models, it will disable the automatic config search for the parameter provided.
75+
Additionally, the `run_config_search_preferred_batch_size_disable` flag can be
76+
set in order to disable automatic config search over the `preferred_batch_size`.
7577

7678
For example, the config specified below will only automatically sweep through
7779
the `model_config_parameters` that was described above:

0 commit comments

Comments
 (0)