@@ -13,13 +13,15 @@ This example demonstrates how to perform inference of [Ultralytics YOLO12 family
1313# Performance Evaluation
1414
1515| CPU | Model | Backend | Device | Precision | Average Latency, ms |
16- | --------------------------------| ---------| ----------| --------| -----------| -----------------|
17- | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | FP32 | 88.3549 |
18- | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | INT8 | 53.066 |
19- | Intel(R) Core(TM) Ultra 7 155H | yolo12l | openvino | CPU | FP32 | 317.953 |
20- | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | INT8 | 150.846 |
21- | Intel(R) Core(TM) Ultra 7 155H | yolo12s | xnnpack | CPU | FP32 | 169.36 |
22- | Intel(R) Core(TM) Ultra 7 155H | yolo12l | xnnpack | CPU | FP32 | 436.876 |
16+ | --------------------------------| ---------| ----------| --------| -----------| ---------------------|
17+ | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | FP32 | 88.3549 |
18+ | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | INT8 | 53.066 |
19+ | Intel(R) Core(TM) Ultra 7 155H | yolo12l | openvino | CPU | FP32 | 317.953 |
20+ | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | CPU | INT8 | 150.846 |
21+ | Intel(R) Core(TM) Ultra 7 155H | yolo12s | openvino | GPU | FP32 | 32.71 |
22+ | Intel(R) Core(TM) Ultra 7 155H | yolo12l | openvino | GPU | FP32 | 70.885 |
23+ | Intel(R) Core(TM) Ultra 7 155H | yolo12s | xnnpack | CPU | FP32 | 169.36 |
24+ | Intel(R) Core(TM) Ultra 7 155H | yolo12l | xnnpack | CPU | FP32 | 436.876 |
2325
2426
2527# Instructions
@@ -63,6 +65,7 @@ XNNPACK:
6365python export_and_validate.py --model_name yolo12s --input_dims=[1920,1080] --backend xnnpack
6466```
6567
68+ > ** _ NOTE:_ ** Quantization for XNNPACK backend is WIP. Please refere to https://github.com/pytorch/executorch/issues/11523 for more details.
6669
6770Exported model could be validated using the ` --validate ` key:
6871
0 commit comments