File tree Expand file tree Collapse file tree 1 file changed +10
-3
lines changed Expand file tree Collapse file tree 1 file changed +10
-3
lines changed Original file line number Diff line number Diff line change @@ -215,15 +215,22 @@ you can use darknet2pytorch to convert it yourself, or download my converted mod
215215# 7. ONNX2TensorRT and DeepStream Inference
216216
217217 1. Compile the DeepStream Nvinfer Plugin
218- ```cd DeepStream
218+
219+ ```
220+ cd DeepStream
219221 make
220222 ```
221223 2. Build a TRT Engine.
224+
222225 For single batch,
223- ``` trtexec --onnx=<onnx_file> --explicitBatch --saveEngine=<tensorRT_engine_file> --workspace=<size_in_megabytes> --fp16 ```
226+ ```
227+ trtexec --onnx=<onnx_file> --explicitBatch --saveEngine=<tensorRT_engine_file> --workspace=<size_in_megabytes> --fp16
228+ ```
224229
225230 For multi-batch,
226- ``` trtexec --onnx=<onnx_file> --explicitBatch --shapes=input:Xx3xHxW --optShapes=input:Xx3xHxW --maxShapes=input:Xx3xHxW --minShape=input:1x3xHxW --saveEngine=<tensorRT_engine_file> --fp16 ```
231+ ```
232+ trtexec --onnx=<onnx_file> --explicitBatch --shapes=input: Xx3xHxW --optShapes=input: Xx3xHxW --maxShapes=input: Xx3xHxW --minShape=input:1x3xHxW --saveEngine=<tensorRT_engine_file> --fp16
233+ ```
227234
228235 Note :The maxShapes could not be larger than model original shape.
229236
You can’t perform that action at this time.
0 commit comments