BuildingForLinux

Building for Linux

To install software requirements, please follow instructions. This manual is for Ubuntu 20.04, for other OS it may be different.

DLI supports several inference frameworks:

Intel® Distribution of OpenVINO™ Toolkit (C++ and Python APIs).
Intel® Optimization for Caffe (Python API).
Intel® Optimizations for TensorFlow (Python API).
TensorFlow Lite (C++ and Python APIs).
ONNX Runtime (C++ and Python APIs).
MXNet (Python Gluon API).
OpenCV DNN (C++ and Python APIs).
PyTorch (C++ and Python APIs).

Common pre-requisites

Install Python tools (Python 3.8 is already installed by default in Ubuntu 20.04).
```
sudo apt install python3-pip python3-venv python3-tk
```

Create and activate virtual environment.

cd ~/
python3 -m venv dl-benchmark-env
source ~/dl-benchmark-env/bin/activate
python3 -m pip install --upgrade pip

Clone repository.

sudo apt install git
git clone https://github.com/itlab-vision/dl-benchmark.git

Install requirements.

pip install -r ~/dl-benchmark/requirements.txt

OpenVINO toolkit pre-requisites

Python API

If you would like to infer deep models using the Intel® Distribution of OpenVINO™ Toolkit (Python API), please, install openvino-dev package using pip.

pip install openvino-dev[caffe,mxnet,onnx,pytorch,tensorflow]==2022.1.0

Note: there is no way to install tensorflow and tensorflow2 packages to the single virtual environment, so to convert tensorflow2 models, please, create another virtual environment and install openvino-dev package with the support of tensorflow2:

pip install openvino-dev[tensorflow2]==2022.1.0

C++ API

If you would like to infer deep models using the Intel® Distribution of OpenVINO™ Toolkit (C++ API), please, install the OpenVINO toolkit from sources or download pre-built package and follow Benchmark C++ tool build instructions to get OpenVINO C++ benchmark app built.

Intel-caffe pre-requisites

If you prefer Intel® Optimization for Caffe to infer deep neural networks, please, install Miniconda or Anaconda and corresponding package intel-caffe.

conda install -c intel-caffe

Intel-tensorflow pre-requisites

If you would like to infer deep models using the Intel® Optimization for TensorFlow, please, install package intel-tensorflow using pip.

pip install intel-tensorflow

TensorFlow lite pre-requisites

Python API

To infer deep learning models using the TensorFlow lite framework please install tensorflow python package.

pip install tensorflow

C++ API

TensorFlow lite CPP requires to be built from sources along with dedicated benchmark tool. Please refer to build instruction to build binaries.

ONNX Runtime pre-requisites

Python API

To infer deep learning models using ONNX Runtime (Python API), please, install the corresponding package.

pip install onnxruntime

C++ API

ONNX Runtime requires to be built from sources along with dedicated benchmark tool. Please refer to build instruction to build binaries.

MXNet pre-requisites

Python API

If you would like to infer deep models using MXNet please install mxnet python package.

pip install mxnet

OpenCV DNN pre-requisites

Python API

[TBD]

C++ API

OpenCV DNN CPP requires to be built from sources along with dedicated benchmark tool. Please refer to build instruction to build binaries.

PyTorch pre-requisites

Python API

To infer deep learning models using PyTorch, please, install the following packages:

pip install torch torchvision torchaudio

C++ API

PyTorch CPP requires to be built from sources along with dedicated benchmark tool. Please refer to build instruction to build binaries.

BuildingForLinux