The Intel® Distribution of OpenVINO™ toolkit quickly deploys applications and solutions that emulate human vision. Based on Convolutional Neural Networks (CNN), the toolkit extends computer vision (CV) workloads across Intel® hardware, maximizing performance. The Intel® Distribution of OpenVINO™ toolkit includes the Intel® Deep Learning Deployment Toolkit (Intel® DLDT).
The Intel® Distribution of OpenVINO™ toolkit for Linux*:
Included with the Installation and installed by default:
|Model Optimizer||This tool imports, converts, and optimizes models that were trained in popular frameworks to a format usable by Intel tools, especially the Inference Engine. |
Popular frameworks include Caffe*, TensorFlow*, MXNet*, and ONNX*.
|Inference Engine||This is the engine that runs the deep learning model. It includes a set of libraries for an easy inference integration into your applications.|
|Drivers and runtimes for OpenCL™ version 2.1||Enables OpenCL on the GPU/CPU for Intel® processors|
|Intel® Media SDK||Offers access to hardware accelerated video codecs and frame processing|
|OpenCV version 3.4.2||OpenCV* community version compiled for Intel® hardware. Includes PVL libraries for computer vision|
|OpenVX* version 1.1||Intel's implementation of OpenVX* 1.1 optimized for running on Intel® hardware (CPU, GPU, IPU)|
|Demos and Sample Applications||A set of simple console applications demonstrating how to use the Inference Engine in your applications|
The development and target platforms have the same requirements, but you can select different components during the installation, based on your intended use.
This guide provides step-by-step instructions on how to install the Intel® Distribution of OpenVINO™ toolkit. Links are provided for each type of compatible hardware including downloads, initialization and configuration steps. The following steps will be covered:
Download the Intel® Distribution of OpenVINO™ toolkit package file from Intel® Distribution of OpenVINO™ toolkit for Linux*. Select the Intel® Distribution of OpenVINO™ toolkit for Linux package from the dropdown menu.
The first core components are installed. Continue to the next section to install additional dependencies.
These dependencies are required for:
You must update several environment variables before you can compile and run OpenVINO™ applications. Run the following script to temporarily set your environment variables:
Optional: The OpenVINO environment variables are removed when you close the shell. As an option, you can permanently set the environment variables as follows:
[setupvars.sh] OpenVINO environment initialized.
The environment variables are set. Continue to the next section to configure the Model Optimizer.
The Model Optimizer is a Python*-based command line tool for importing trained models from popular deep learning frameworks such as Caffe*, TensorFlow*, Apache MXNet*, ONNX* and Kaldi*.
The Model Optimizer is a key component of the Intel Distribution of OpenVINO toolkit. You cannot perform inference on your trained model without running the model through the Model Optimizer. When you run a pre-trained model through the Model Optimizer, your output is an Intermediate Representation (IR) of the network. The Intermediate Representation is a pair of files that describe the whole model:
.xml: Describes the network topology
.bin: Contains the weights and biases binary data
For more information about the Model Optimizer, refer to the Model Optimizer Developer Guide.
You can choose to either configure all supported frameworks at once OR configure one framework at a time. Choose the option that best suits your needs. If you see error messages, make sure you installed all dependencies.
NOTE: Since the TensorFlow framework is not officially supported on CentOS*, the Model Optimizer for TensorFlow can't be configured and ran on those systems.
IMPORTANT: The Internet access is required to execute the following steps successfully. If you have access to the Internet through the proxy server only, please make sure that it is configured in your environment.
NOTE: If you installed the Intel® Distribution of OpenVINO™ to the non-default install directory, replace
/opt/intelwith the directory in which you installed the software.
Option 1: Configure all supported frameworks at the same time
Option 2: Configure each framework separately
Configure individual frameworks separately ONLY if you did not select Option 1 above.
You are ready to compile the samples by running the verification scripts.
IMPORTANT: This section is required. In addition to confirming your installation was successful, demo scripts perform other steps, such as setting up your computer to use the Inference Engine samples.
To verify the installation and compile two samples, run the verification applications provided with the product on the CPU:
car.pngimage located in the demo directory. When the verification script completes, you will have the label and confidence for the top-10 categories:
Run the Inference Pipeline verification script:
This script downloads three pre-trained models IRs, builds the Security Barrier Camera Demo application and run it with the downloaded models and the
car_1.bmp image from the
demo directory to show an inference pipeline. The verification script uses vehicle recognition in which vehicle attributes build on each other to narrow in on a specific attribute.
First, an object is identified as a vehicle. This identification is used as input to the next model, which identifies specific vehicle attributes, including the license plate. Finally, the attributes identified as the license plate are used as input to the third model, which recognizes specific characters in the license plate.
When the verification script completes, you will see an image that displays the resulting frame with detections rendered as bounding boxes, and text:
To learn about the verification scripts, see the
README.txt file in
For a description of the Intel Distribution of OpenVINO™ pre-trained object detection and object recognition models, see Overview of OpenVINO™ Toolkit Pre-Trained Models.
You have completed all required installation, configuration and build steps in this guide to use your CPU to work with your trained models. To use other hardware, see;
The steps in this section are required only if you want to enable the toolkit components to use processor graphics (GPU) on your system.
Ignore those suggestions and continue.
These steps are only required if you want to perform inference on Intel® Movidius™ NCS powered by the Intel® Movidius™ Myriad™ 2 VPU or Intel® Neural Compute Stick 2 powered by the Intel® Movidius™ Myriad™ X VPU. See also the Get Started page for Intel® Neural Compute Stick 2:
To install and configure your Intel® Vision Accelerator Design with Intel® Movidius™ VPU see the Intel® Vision Accelerator Design with Intel® Movidius™ VPUs Installation Guide
NOTE: After installing your Intel® Movidius™ VPU, you will return to this guide to complete OpenVINO™ installation.
You are ready to run the Classification Sample, which you have compiled by running the Image Classification verification script in the Run the Verification Scripts to Verify Installation section.
IMPORTANT: This section requires that you have Run the Verification Scripts to Verify Installation.
Setting up a neural network is the first step in running a sample.
NOTE: If you are running inference only on a CPU, you already have the required FP32 neural network model. If you want to run inference on any hardware other than the CPU, you'll need an FP16 version of the model, which you will set up in the following section.
Set Up a Neural Network Model
In this section, you will create an FP16 model suitable for hardware accelerators.
squeezenet1.1.labelsfile contains the classes that ImageNet uses. This file is included so that the inference results show text instead of classification numbers. Copy
squeezenet1.1.labelsto your optimized model location:
Once your neural network setup is complete, you're ready to run a sample application.
For information on Sample Applications, see the Inference Engine Samples Overview.
Congratulations, you have finished the Intel® Distribution of OpenVINO™ toolkit installation for Linux. To learn more about how the Intel® Distribution of OpenVINO™ toolkit works, the Hello World tutorial and other resources are provided below.
To learn more about converting models, go to: