Skip to content

Commit 26dec1e

Browse files
committed
setup link
Signed-off-by: Yang Wang <[email protected]>
1 parent e97850b commit 26dec1e

File tree

2 files changed

+6
-6
lines changed

2 files changed

+6
-6
lines changed

.ci/scripts/benchmark_tooling/README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -76,8 +76,8 @@ python3 .ci/scripts/benchmark_tooling/analyze_benchmark_stability.py \
7676

7777
##### Filtering Options:
7878

79-
- `--private-device-pools`: Filter by private device pool names (e.g., "samsung-galaxy-s22-5g", "samsung-galaxy-s22plus-5g")
80-
- `--backends`: Filter by specific backend names (e.g., "qnn-q8", "llama3-spinquan")
79+
- `--device-pools`: Filter by private device pool names (e.g., "samsung-galaxy-s22-5g", "samsung-galaxy-s22plus-5g")
80+
- `--backends`: Filter by specific backend names (e.g.,"xnnpack_q8")
8181
- `--models`: Filter by specific model names (e.g., "mv3", "meta-llama-llama-3.2-1b-instruct-qlora-int4-eo8")
8282

8383
#### Example Usage
@@ -88,7 +88,7 @@ Filter by multiple private device pools and models:
8888
python3 get_benchmark_analysis_data.py \
8989
--startTime "2025-06-01T00:00:00" \
9090
--endTime "2025-06-11T00:00:00" \
91-
--private-device-pools 'apple_iphone_15_private' 'samsung_s22_private' \
91+
--device-pools 'apple_iphone_15_private' 'samsung_s22_private' \
9292
--models 'meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8' 'mv3'
9393
```
9494

@@ -99,7 +99,7 @@ Filter by specific device pool and models:
9999
python3 get_benchmark_analysis_data.py \
100100
--startTime "2025-06-01T00:00:00" \
101101
--endTime "2025-06-11T00:00:00" \
102-
--private-device-pools 'apple_iphone_15_private' \
102+
--device-pools 'apple_iphone_15_private' \
103103
--models 'meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8' 'mv3'
104104
```
105105

.ci/scripts/benchmark_tooling/get_benchmark_analysis_data.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -735,7 +735,7 @@ def argparsers():
735735
help="Filter results by one or more backend full name(e.g. --backends qlora mv3) (OR logic within backends scope, AND logic with other filter type)",
736736
)
737737
parser.add_argument(
738-
"--private-device-pools",
738+
"--device-pools",
739739
nargs="+", # allow one or more values
740740
choices=VALID_PRIVATE_DEVICE_POOLS_NAMES,
741741
help="List of devices to include [apple_iphone_15_private, samsung_s22_private, you can include both] (OR logic within private-device-pools scope, AND logic with other filter type)",
@@ -757,7 +757,7 @@ def argparsers():
757757
filters=BenchmarkFilters(
758758
models=args.models,
759759
backends=args.backends,
760-
devicePoolNames=args.private_device_pools,
760+
devicePoolNames=args.device_pools,
761761
),
762762
)
763763
fetcher.output_data(args.outputType, args.outputDir)

0 commit comments

Comments
 (0)