Skip to content

openvino量化后,无法推理 #584

@gogocoded

Description

@gogocoded

请教一个问题,我使用例子量化yolov5s模型,导出到openvino平台无法推理,错误提示如下:
Traceback (most recent call last):
File "D:\v6sp3_sp_quan\ProgramEntrance_openvino.py", line 63, in
model = openvino_executor.read_model(model="model_int8.onnx"), device_name="CPU")
File "D:\anaconda3\lib\site-packages\openvino\runtime\ie_api.py", line 511, in read_model
return Model(super().read_model(model))
RuntimeError: Exception from src\inference\src\core.cpp:85:
Check 'error_message.empty()' failed at src\frontends\onnx\frontend\src\frontend.cpp:124:
Errors during ONNX translation:
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_318>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.9/cv1/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_310>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.8/cv3/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_296>':
"x" input data type must be static.
While validating ONNX node '<Node(Conv): /model.8/cv2/conv/Conv>':
Check 'data.get_partial_shape().rank().is_static()' failed at src\frontends\onnx\frontend\src\op\conv.cpp:44:
The input data tensor's rank has to be known (static)
Check '(data_et.is_static())' failed at src\frontends\onnx\frontend\src\op\quantize_linear.cpp:56:
While validating ONNX node '<Node(QuantizeLinear): PPQ_Operation_258>':
"x" input data type must be static.
。。。。

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions