Skip to content

OpenVINO EP V4.0 Release for ONNX Runtime 1.11.0 & OpenVINO 2022.1

Choose a tag to compare

@MaajidKhan MaajidKhan released this 07 Apr 06:34
· 11762 commits to master since this release
530117c

Description:
OpenVINO-EP v4.0 Release PR with OpenVINO 2022.1

Motivation and Context:
OpenVINO-EP now supports the latest OpenVINO 2022.1 version
OpenVINO-EP is now updated to use the new OpenVINO 2.0 API's starting from this release
Backward compatibility support for older OpenVINO versions (OV 2021.3, OV 2021.4) is available
New code design changes introduced to have cleaner code structure for different OpenVINO versions
Opset 13 compliance w.r.t OpenVINO (More operators added)
New features added (GPU opencl throttling, device type checks)

For all the latest information, Refer to our documentation:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html

Build steps:
Please refer to the OpenVINO EP build instructions for information on system pre-requisites as well as instructions to build from source.
https://onnxruntime.ai/docs/build/eps.html#openvino

OpenVINO-EP samples:
https://github.com/microsoft/onnxruntime-inference-examples

Python Pip Wheel packages:
Find below pre-built Python wheel packages (zipped) that can be installed on a dev machine with OpenVINO 2022.1 installed. Please refer to the OpenVINO EP build instructions for information on system pre-requisites.

Docker Image:
The latest OpenVINO EP docker image can be downloaded from dockerhub.
https://hub.docker.com/r/openvino/onnxruntime_ep_ubuntu18

Nuget Package:
The latest OpenVINO EP Nuget Package for Windows can be downloaded from below repo

APIs:
Please refer to the link below for Python/C++ APIs:
https://onnxruntime.ai/docs/execution-providers/OpenVINO-ExecutionProvider.html#configuration-options

Note: We have few python tests disabled with OpenVINO 2022.1. This would be fixed with the next release.