File tree Expand file tree Collapse file tree 2 files changed +9
-4
lines changed Expand file tree Collapse file tree 2 files changed +9
-4
lines changed Original file line number Diff line number Diff line change @@ -630,7 +630,7 @@ profile_models:
630630 model_1:
631631 perf_analyzer_flags:
632632 percentile: 95
633- latency_report_file : /path/to/latency/report/file
633+ latency-report-file : /path/to/latency/report/file
634634` ` `
635635
636636The `perf_analyzer_flags` section can also be specified globally to affect
@@ -644,10 +644,13 @@ profile_models:
644644 batch_sizes: 4
645645perf_analyzer_flags:
646646 percentile: 95
647- latency_report_file : /path/to/latency/report/file
647+ latency-report-file : /path/to/latency/report/file
648648` ` `
649649
650- **Important Notes**:
650+ **Important Notes**:
651+ * When providing arguments under `perf_analyzer_flags`, you must use `-` instead
652+ of `_`. This casing is important and Model Analyzer will not recognize
653+ ` snake_cased` arguments.
651654* The Model Analyzer also provides certain arguments to the `perf_analyzer`
652655 instances it launches. They are the following :
653656 * `concurrency-range`
@@ -703,7 +706,7 @@ profile_models:
703706 exit_timeout_secs: 120
704707` ` `
705708
706- **Important Notes**:
709+ **Important Notes**:
707710* The Model Analyzer also provides certain arguments to the `tritonserver`
708711 instances it launches. These ***cannot*** be overriden by providing those
709712 arguments in this section. An example of this is `http-port`, which is an
Original file line number Diff line number Diff line change @@ -72,6 +72,8 @@ profile_models:
7272
7373If either `concurrency` or `model_config_parameters` is specified for one of the
7474models, it will disable the automatic config search for the parameter provided.
75+ Additionally, the `run_config_search_preferred_batch_size_disable` flag can be
76+ set in order to disable automatic config search over the `preferred_batch_size`.
7577
7678For example, the config specified below will only automatically sweep through
7779the `model_config_parameters` that was described above :
You can’t perform that action at this time.
0 commit comments