OpenVINO EP for OpenVINO 2020.2 release
Description:
Version update for OpenVINO Execution Provider. Based on the latest OpenVINO release 2020.2 which now includes nGraph stack. Model conversion from ONNX to OpenVINO IR is now done using nGraph ONNX importer component.
Motivation and Context
- Supports a larger set of ONNX operators
- Supports inference of partial models using sub-graph partitioning
- Supports models with symbolic dimensions in shapes.
- Uses OpenVINO APIs with Long Term Support (LTS) providing extended support and backward compatibility.
- Upto 40% reduction in memory footprint.
- Avoids using the python components used by existing version EP thus avoiding expensive python interpreter startup and module conflicts arising from it.