Skip to content

v4.1.0 onnx run failed & convert to TensorRT .engine failed #45

@oUp2Uo

Description

@oUp2Uo

Hi, I found that v4.1.0 provides onnx file now. (https://catalog.ngc.nvidia.com/orgs/nvidia/teams/isaac/models/dnn_stereo_disparity?version=4.1.0)
I could open the downloaded onnx file with Netron and see the graph.

  1. I tried to run the onnx model with onnxruntime c++ on PC.
    But it failed when creating the ort session.
    The error thrown is ORT_INVALID_GRAPH.
    onnxruntime version is 1.22.0, tested using CPU & CUDA provider, both the same result.

  2. I tried to use it to convert to .engine file:
    trtexec --onnx=ess.onnx --saveEngine=1.engine --fp16
    But the the conversion failed.
    Tested with CUDA12, TensorRT-10.11.0.33 & TensorRT-10.13.3.9, both the same result.

Here is some part of the message:

[10/16/2025-11:51:21] [I] [TRT] ----------------------------------------------------------------
[10/16/2025-11:51:21] [I] [TRT] Searching for plugin wth node domain namespace:
[10/16/2025-11:51:21] [I] [TRT] Searching for plugin wth node domain namespace:
[10/16/2025-11:51:21] [I] [TRT] Searching for plugin wth node domain namespace:
[10/16/2025-11:51:21] [I] [TRT] Searching for plugin wth node domain namespace:
[10/16/2025-11:51:21] [I] [TRT] Searching for plugin wth node domain namespace:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:137: While parsing node number 178 [FusedConcatConv3x3 -> "/model/feature_extractor/lastconv/lastconv.3/Conv_output_0"]:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:138: --- Begin node ---
input: "/model/feature_extractor/layer1/layer1.1/Add_output_0"
input: "/model/feature_extractor/Resize_3_output_0"
input: "/model/feature_extractor/Resize_2_output_0"
input: "/model/feature_extractor/Resize_1_output_0"
input: "/model/feature_extractor/Resize_output_0"
input: "onnx::Conv_713"
input: "onnx::Conv_714"
input: "model.feature_extractor.lastconv.3.weight"
output: "/model/feature_extractor/lastconv/lastconv.3/Conv_output_0"
name: "FusedConcatConv3x3_left"
op_type: "FusedConcatConv3x3"
attribute {
  name: "dilations_Conv1"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv1"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv1"
  ints: 3
  ints: 3
  type: INTS
}
attribute {
  name: "pads_Conv1"
  ints: 1
  ints: 1
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "strides_Conv1"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "dilations_Conv2"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv2"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv2"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "pads_Conv2"
  ints: 0
  ints: 0
  ints: 0
  ints: 0
  type: INTS
}
attribute {
  name: "strides_Conv2"
  ints: 1
  ints: 1
  type: INTS
}

[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:139: --- End node ---
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:142: ERROR: onnxOpCheckers.cpp:838 In function checkFallbackPluginImporter:
[6] creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:137: While parsing node number 179 [FusedConcatConv3x3 -> "/model/feature_extractor/lastconv/lastconv.3_1/Conv_output_0"]:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:138: --- Begin node ---
input: "/model/feature_extractor/layer1/layer1.1_1/Add_output_0"
input: "/model/feature_extractor_1/Resize_3_output_0"
input: "/model/feature_extractor_1/Resize_2_output_0"
input: "/model/feature_extractor_1/Resize_1_output_0"
input: "/model/feature_extractor_1/Resize_output_0"
input: "onnx::Conv_749"
input: "onnx::Conv_750"
input: "model.feature_extractor.lastconv.3.weight"
output: "/model/feature_extractor/lastconv/lastconv.3_1/Conv_output_0"
name: "FusedConcatConv3x3_right"
op_type: "FusedConcatConv3x3"
attribute {
  name: "dilations_Conv1"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv1"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv1"
  ints: 3
  ints: 3
  type: INTS
}
attribute {
  name: "pads_Conv1"
  ints: 1
  ints: 1
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "strides_Conv1"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "dilations_Conv2"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv2"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv2"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "pads_Conv2"
  ints: 0
  ints: 0
  ints: 0
  ints: 0
  type: INTS
}
attribute {
  name: "strides_Conv2"
  ints: 1
  ints: 1
  type: INTS
}

[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:139: --- End node ---
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:142: ERROR: onnxOpCheckers.cpp:838 In function checkFallbackPluginImporter:
[6] creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:137: While parsing node number 180 [FusedEinsum2Softmax -> "/model/cost_volume/layers/layers.0/Softmax_output_0"]:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:138: --- Begin node ---
input: "/model/feature_extractor/lastconv/lastconv.3/Conv_output_0"
input: "/model/feature_extractor/lastconv/lastconv.3_1/Conv_output_0"
output: "/model/cost_volume/layers/layers.0/Softmax_output_0"
name: "FusedEinsum2Softmax"
op_type: "FusedEinsum2Softmax"

[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:139: --- End node ---
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:142: ERROR: onnxOpCheckers.cpp:838 In function checkFallbackPluginImporter:
[6] creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:137: While parsing node number 259 [FusedConcat2c128c64Conv3x3c64 -> "/model/stereo_matching/decoder/blocks.3/blocks.3.1/Relu_output_0"]:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:138: --- Begin node ---
input: "/model/stereo_matching/encoder/blocks.0/blocks.0.2/Relu_output_0"
input: "/model/stereo_matching/decoder/Resize_3_output_0"
input: "model.stereo_matching.decoder.blocks.3.0.weight"
input: "model.stereo_matching.decoder.blocks.3.0.bias"
output: "/model/stereo_matching/decoder/blocks.3/blocks.3.1/Relu_output_0"
name: "FusedConcat2c128c64Conv3x3c64"
op_type: "FusedConcat2c128c64Conv3x3c64"
attribute {
  name: "dilations_Conv"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv"
  ints: 3
  ints: 3
  type: INTS
}
attribute {
  name: "pads_Conv"
  ints: 1
  ints: 1
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "strides_Conv"
  ints: 1
  ints: 1
  type: INTS
}

[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:139: --- End node ---
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:142: ERROR: onnxOpCheckers.cpp:838 In function checkFallbackPluginImporter:
[6] creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:137: While parsing node number 264 [FusedConcat2c64c64Conv3x3c64 -> "/model/stereo_matching/decoder/blocks.4/blocks.4.1/Relu_output_0"]:
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:138: --- Begin node ---
input: "/model/stereo_matching/encoder/firstconv/firstconv.1/Relu_output_0"
input: "/model/stereo_matching/decoder/Resize_4_output_0"
input: "model.stereo_matching.decoder.blocks.4.0.weight"
input: "model.stereo_matching.decoder.blocks.4.0.bias"
output: "/model/stereo_matching/decoder/blocks.4/blocks.4.1/Relu_output_0"
name: "FusedConcat2c64c64Conv3x3c64"
op_type: "FusedConcat2c64c64Conv3x3c64"
attribute {
  name: "dilations_Conv"
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "group_Conv"
  i: 1
  type: INT
}
attribute {
  name: "kernel_shape_Conv"
  ints: 3
  ints: 3
  type: INTS
}
attribute {
  name: "pads_Conv"
  ints: 1
  ints: 1
  ints: 1
  ints: 1
  type: INTS
}
attribute {
  name: "strides_Conv"
  ints: 1
  ints: 1
  type: INTS
}

[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:139: --- End node ---
[10/16/2025-11:51:21] [E] [TRT] ModelImporter.cpp:142: ERROR: onnxOpCheckers.cpp:838 In function checkFallbackPluginImporter:
[6] creator && "Plugin not found, are the plugin name, version, and namespace correct?"
[10/16/2025-11:51:21] [E] Failed to parse onnx file
[10/16/2025-11:51:21] [I] Finished parsing network model. Parse time: 0.250286
[10/16/2025-11:51:21] [E] Parsing model failed
[10/16/2025-11:51:21] [E] Failed to create engine from model or file.
[10/16/2025-11:51:21] [E] Engine set up failed

Do you have any idea about these questions?
Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions