Skip to content

Commit 83af660

Browse files
committed
[feat] add readme for running the scripts that collect metrics
1 parent 529ba5b commit 83af660

File tree

1 file changed

+32
-0
lines changed

1 file changed

+32
-0
lines changed

scripts/metrics/README.md

Lines changed: 32 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,32 @@
1+
# Scripts to collect results and generate CVS sheets readdy for MPEG common test conditions
2+
3+
To generate the csv related to a dataset for the OIv6 dataset for instance, modify the paths in the following command and run:
4+
5+
6+
7+
### Example commands to collect the metrics of split-inference pipelines
8+
9+
```
10+
python /path-to-compressai_vision/scripts/metrics/gen_mpeg_cttc_csv.py --dataset_name OIV6 \
11+
--dataset_path /path/to/fcm_testdata/mpeg-oiv6 \
12+
--result_path output_dir/split-inference-image/{codec_name}_{exp_name}/MPEGOIV6
13+
```
14+
15+
For a video dataset, e.g., SFU:
16+
17+
```
18+
python /path-to-compressai_vision/scripts/metrics/gen_mpeg_cttc_csv.py --dataset_name SFU \
19+
--dataset_path /path/to/fcm_testdata/SFU_HW_Obj \
20+
--result_path output_dir/split-inference-video/{codec_name}_{exp_name}/SFUHW
21+
```
22+
23+
### Example commands to collect the metrics of remote-inference pipelines
24+
25+
```
26+
python /path-to-compressai_vision/scripts/metrics/gen_mpeg_cttc_csv.py --dataset_name SFU \
27+
--dataset_path /path/to/vcm_testdata/tvd_tracking \
28+
--result_path output_dir/remote-inference-video/{codec_name}_{exp_name}/MPEGTVDTRACKING/ \
29+
--nb_operation_points 6 \
30+
--remote_inference \
31+
--curve_fit
32+
```

0 commit comments

Comments
 (0)