OpenVINO EP V4.0 Release for ONNX Runtime 1.11.0 & OpenVINO 2022.1
Description:
OpenVINO-EP v4.0 Release PR with OpenVINO 2022.1
Motivation and Context:
OpenVINO-EP now supports the latest OpenVINO 2022.1 version
OpenVINO-EP is now updated to use the new OpenVINO 2.0 API's starting from this release
Backward compatibility support for older OpenVINO versions (OV 2021.3, OV 2021.4) is available
New code design changes introduced to have cleaner code structure for different OpenVINO versions
Opset 13 compliance w.r.t OpenVINO (More operators added)
New features added (GPU opencl throttling, device type checks)
For all the latest information, Refer to our documentation:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html
Build steps:
Please refer to the OpenVINO EP build instructions for information on system pre-requisites as well as instructions to build from source.
https://onnxruntime.ai/docs/build/eps.html#openvino
OpenVINO-EP samples:
https://github.com/microsoft/onnxruntime-inference-examples
Python Pip Wheel packages:
Find below pre-built Python wheel packages (zipped) that can be installed on a dev machine with OpenVINO 2022.1 installed. Please refer to the OpenVINO EP build instructions for information on system pre-requisites.
Docker Image:
The latest OpenVINO EP docker image can be downloaded from dockerhub.
https://hub.docker.com/r/openvino/onnxruntime_ep_ubuntu18
Nuget Package:
The latest OpenVINO EP Nuget Package for Windows can be downloaded from below repo
APIs:
Please refer to the link below for Python/C++ APIs:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html#configuration-options
Note: We have few python tests disabled with OpenVINO 2022.1. This would be fixed with the next release.