@@ -55,6 +55,49 @@ links:
5555- Python: 3.10.12
5656- ONNX Runtime: 1.18.0
5757
58+ ### 转换耗时参考
59+
60+ #### 文本检测模型
61+
62+ | ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
63+ | :---| :---| :---| :---|
64+ | ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 521.02 |
65+ | ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 315.53 |
66+ |||||
67+ | ch_PP-OCRv5_mobile_det.onnx | ch_PP-OCRv5_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 1438.65 |
68+ | ch_PP-OCRv5_mobile_det.onnx | ch_PP-OCRv5_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 407.53 |
69+ |||||
70+ | ch_PP-OCRv4_det_server_infer.onnx | ch_PP-OCRv4_det_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 299.10 |
71+ | ch_PP-OCRv4_det_server_infer.onnx | ch_PP-OCRv4_det_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 109.56 |
72+ |||||
73+ | en_PP-OCRv3_det_infer.onnx | en_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 224.54 |
74+ | en_PP-OCRv3_det_infer.onnx | en_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 87.11 |
75+ |||||
76+ | Multilingual_PP-OCRv3_det_infer.onnx | multi_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 122.11 |
77+ | Multilingual_PP-OCRv3_det_infer.onnx | multi_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 52.64 |
78+ |||||
79+ | ch_PP-OCRv5_server_det.onnx | ch_PP-OCRv5_det_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | - |
80+ | ch_PP-OCRv5_server_det.onnx | ch_PP-OCRv5_det_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | - |
81+
82+ #### 文本识别模型
83+
84+ | ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
85+ | :---| :---| :---| :---|
86+ | ch_PP-OCRv4_rec_infer.onnx | ch_PP-OCRv4_rec_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 603.08 |
87+ | ch_PP-OCRv4_rec_infer.onnx | ch_PP-OCRv4_rec_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 480.52 |
88+ |||||
89+ | ch_PP-OCRv4_rec_server_infer.onnx | ch_PP-OCRv4_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 175.15 |
90+ | ch_PP-OCRv4_rec_server_infer.onnx | ch_PP-OCRv4_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 77.45 |
91+ |||||
92+ | ch_doc_PP-OCRv4_rec_server_infer.onnx | ch_doc_PP-OCRv4_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 107.10 |
93+ | ch_doc_PP-OCRv4_rec_server_infer.onnx | ch_doc_PP-OCRv4_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 45.46 |
94+ |||||
95+ | ch_PP-OCRv5_rec_mobile_infer.onnx | ch_PP-OCRv5_rec_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 1437.16 |
96+ | ch_PP-OCRv5_rec_mobile_infer.onnx | ch_PP-OCRv5_rec_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 543.68 |
97+ |||||
98+ | ch_PP-OCRv5_rec_server_infer.onnx | ch_PP-OCRv5_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 159.35 |
99+ | ch_PP-OCRv5_rec_server_infer.onnx | ch_PP-OCRv5_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 69.82 |
100+
58101## 支持Det模型
59102
60103### 比较转化前后推理精度差异
@@ -206,12 +249,6 @@ links:
206249 print(metric)
207250 ```
208251
209- ### 转换耗时参考
210-
211- | ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
212- | :---:| :---:| :---:| :---:|
213- | ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 518s |
214-
215252### 结果对比
216253
217254!!! tip
0 commit comments