Skip to content

Commit c05f709

Browse files
authored
docs: update blog
1 parent f46883a commit c05f709

File tree

1 file changed

+43
-6
lines changed

1 file changed

+43
-6
lines changed

docs/blog/posts/inference_engine/support_tensorrt.md

Lines changed: 43 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,49 @@ links:
5555
- Python: 3.10.12
5656
- ONNX Runtime: 1.18.0
5757

58+
### 转换耗时参考
59+
60+
#### 文本检测模型
61+
62+
|ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
63+
|:---|:---|:---|:---|
64+
| ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 521.02 |
65+
| ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 315.53 |
66+
|||||
67+
| ch_PP-OCRv5_mobile_det.onnx | ch_PP-OCRv5_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 1438.65 |
68+
| ch_PP-OCRv5_mobile_det.onnx | ch_PP-OCRv5_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 407.53 |
69+
|||||
70+
| ch_PP-OCRv4_det_server_infer.onnx | ch_PP-OCRv4_det_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 299.10 |
71+
| ch_PP-OCRv4_det_server_infer.onnx | ch_PP-OCRv4_det_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 109.56 |
72+
|||||
73+
| en_PP-OCRv3_det_infer.onnx | en_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 224.54 |
74+
| en_PP-OCRv3_det_infer.onnx | en_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 87.11 |
75+
|||||
76+
| Multilingual_PP-OCRv3_det_infer.onnx | multi_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 122.11 |
77+
| Multilingual_PP-OCRv3_det_infer.onnx | multi_PP-OCRv4_det_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 52.64 |
78+
|||||
79+
| ch_PP-OCRv5_server_det.onnx | ch_PP-OCRv5_det_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | - |
80+
| ch_PP-OCRv5_server_det.onnx | ch_PP-OCRv5_det_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | - |
81+
82+
#### 文本识别模型
83+
84+
|ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
85+
|:---|:---|:---|:---|
86+
| ch_PP-OCRv4_rec_infer.onnx | ch_PP-OCRv4_rec_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 603.08 |
87+
| ch_PP-OCRv4_rec_infer.onnx | ch_PP-OCRv4_rec_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 480.52 |
88+
|||||
89+
| ch_PP-OCRv4_rec_server_infer.onnx | ch_PP-OCRv4_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 175.15 |
90+
| ch_PP-OCRv4_rec_server_infer.onnx | ch_PP-OCRv4_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 77.45 |
91+
|||||
92+
| ch_doc_PP-OCRv4_rec_server_infer.onnx | ch_doc_PP-OCRv4_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 107.10 |
93+
| ch_doc_PP-OCRv4_rec_server_infer.onnx | ch_doc_PP-OCRv4_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 45.46 |
94+
|||||
95+
| ch_PP-OCRv5_rec_mobile_infer.onnx | ch_PP-OCRv5_rec_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 1437.16 |
96+
| ch_PP-OCRv5_rec_mobile_infer.onnx | ch_PP-OCRv5_rec_mobile_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 543.68 |
97+
|||||
98+
| ch_PP-OCRv5_rec_server_infer.onnx | ch_PP-OCRv5_rec_server_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 159.35 |
99+
| ch_PP-OCRv5_rec_server_infer.onnx | ch_PP-OCRv5_rec_server_sm80_fp32.engine | NVIDIA A800-SXM4-80GB | 69.82 |
100+
58101
## 支持Det模型
59102

60103
### 比较转化前后推理精度差异
@@ -206,12 +249,6 @@ links:
206249
print(metric)
207250
```
208251

209-
### 转换耗时参考
210-
211-
|ONNX 模型| TensorRT Engine 格式 | 硬件设备 | 耗时(s) |
212-
|:---:|:---:|:---:|:---:|
213-
| ch_PP-OCRv4_det_infer.onnx | ch_PP-OCRv4_det_mobile_sm80_fp16.engine | NVIDIA A800-SXM4-80GB | 518s |
214-
215252
### 结果对比
216253

217254
!!! tip

0 commit comments

Comments
 (0)