Install OpenVINO™ toolkit for Raspbian* OS

NOTE:

  • These steps apply to 32-bit Raspbian* OS, which is an official OS for Raspberry Pi* boards.
  • These steps have been validated with Raspberry Pi 3*.
  • All steps in this guide are required unless otherwise stated.
  • An internet connection is required to follow the steps in this guide. If you have access to the Internet through the proxy server only, please make sure that it is configured in your OS environment.

Introduction

The OpenVINO™ toolkit quickly deploys applications and solutions that emulate human vision. Based on Convolutional Neural Networks (CNN), the toolkit extends computer vision (CV) workloads across Intel® hardware, maximizing performance. The OpenVINO toolkit includes the Intel® Deep Learning Deployment Toolkit (Intel® DLDT).

The OpenVINO™ toolkit for Raspbian* OS includes the Inference Engine and the MYRIAD plugins. You can use it with the Intel® Neural Compute Stick 2 plugged in one of USB ports.

Included in the Installation Package

The OpenVINO toolkit for Raspbian OS is an archive with pre-installed header files and libraries. The following components are installed by default:

Component Description
Inference Engine This is the engine that runs the deep learning model. It includes a set of libraries for an easy inference integration into your applications.
OpenCV* OpenCV* community version compiled for Intel® hardware.
Sample Applications A set of simple console applications demonstrating how to use Intel's Deep Learning Inference Engine in your applications.

NOTE:

  • The package does not include the Model Optimizer. To convert models to Intermediate Representation (IR), you need to install it separately to your host machine.
  • The package does not include the Open Model Zoo demo applications. You can download them separately from the Open Models Zoo repository.

Development and Target Platforms

Hardware

  • Raspberry Pi* board with ARM* ARMv7-A CPU architecture. Check that uname -m returns armv7l.
  • One of Intel® Movidius™ Visual Processing Units (VPU):
    • Intel® Neural Compute Stick 2

NOTE: With OpenVINO™ 2020.4 release, Intel® Movidius™ Neural Compute Stick is no longer supported.

Operating Systems

  • Raspbian* Buster, 32-bit
  • Raspbian* Stretch, 32-bit

Software

  • CMake* 3.7.2 or higher
  • Python* 3.5, 32-bit

Overview

This guide provides step-by-step instructions on how to install the OpenVINO™ toolkit for Raspbian* OS. Links are provided for each type of compatible hardware including downloads, initialization and configuration steps. The following steps will be covered:

  1. Install the OpenVINO™ toolkit
  2. Install External Software Dependencies
  3. Set the environment variables
  4. Add USB rules
  5. Run the Object Detection Sample to validate Inference Engine installation
  6. Learn About Workflow for Raspberry Pi

Install the OpenVINO™ Toolkit for Raspbian* OS Package

The guide assumes you downloaded the OpenVINO toolkit for Raspbian* OS. If you do not have a copy of the toolkit package file l_openvino_toolkit_runtime_raspbian_p_<version>.tgz, download the latest version from the OpenVINO™ Toolkit packages storage and then return to this guide to proceed with the installation.

NOTE: The OpenVINO toolkit for Raspbian OS is distributed without installer, so you need to perform extra steps comparing to the Intel® Distribution of OpenVINO™ toolkit for Linux* OS.

  1. Open the Terminal* or your preferred console application.
  2. Go to the directory in which you downloaded the OpenVINO toolkit. This document assumes this is your ~/Downloads directory. If not, replace ~/Downloads with the directory where the file is located.
    cd ~/Downloads/
    By default, the package file is saved as l_openvino_toolkit_runtime_raspbian_p_<version>.tgz.
  3. Create an installation folder.
    sudo mkdir -p /opt/intel/openvino
  4. Unpack the archive:
    sudo tar -xf l_openvino_toolkit_runtime_raspbian_p_<version>.tgz --strip 1 -C /opt/intel/openvino

Now the OpenVINO toolkit components are installed. Additional configuration steps are still required. Continue to the next sections to install External Software Dependencies, configure the environment and set up USB rules.

Install External Software Dependencies

CMake* version 3.7.2 or higher is required for building the Inference Engine sample application. To install, open a Terminal* window and run the following command:

sudo apt install cmake

CMake is installed. Continue to the next section to set the environment variables.

Set the Environment Variables

You must update several environment variables before you can compile and run OpenVINO toolkit applications. Run the following script to temporarily set the environment variables:

source /opt/intel/openvino/bin/setupvars.sh

**(Optional)** The OpenVINO environment variables are removed when you close the shell. As an option, you can permanently set the environment variables as follows:

echo "source /opt/intel/openvino/bin/setupvars.sh" >> ~/.bashrc

To test your change, open a new terminal. You will see the following:

[setupvars.sh] OpenVINO environment initialized

Continue to the next section to add USB rules for Intel® Neural Compute Stick 2 devices.

Add USB Rules

  1. Add the current Linux user to the users group:
    sudo usermod -a -G users "$(whoami)"
    Log out and log in for it to take effect.
  2. If you didn't modify .bashrc to permanently set the environment variables, run setupvars.sh again after logging in:
    source /opt/intel/openvino/bin/setupvars.sh
  3. To perform inference on the Intel® Neural Compute Stick 2, install the USB rules running the install_NCS_udev_rules.sh script:
    sh /opt/intel/openvino/install_dependencies/install_NCS_udev_rules.sh
  4. Plug in your Intel® Neural Compute Stick 2.

You are ready to compile and run the Object Detection sample to verify the Inference Engine installation.

Build and Run Object Detection Sample

Follow the next steps to run pre-trained Face Detection network using Inference Engine samples from the OpenVINO toolkit.

  1. Navigate to a directory that you have write access to and create a samples build directory. This example uses a directory named build:
    mkdir build && cd build
  2. Build the Object Detection Sample:
    cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_CXX_FLAGS="-march=armv7-a" /opt/intel/openvino/deployment_tools/inference_engine/samples/cpp
    make -j2 object_detection_sample_ssd
  3. Download the pre-trained Face Detection model with the Model Downloader or copy it from the host machine:

    ```sh git clone –depth 1 https://github.com/openvinotoolkit/open_model_zoo cd open_model_zoo/tools/downloader python3 -m pip install -r requirements.in python3 downloader.py –name face-detection-adas-0001

    4. Run the sample with specifying the model and a path to the input image:
    ```sh
    ./armv7l/Release/object_detection_sample_ssd -m face-detection-adas-0001.xml -d MYRIAD -i <path_to_image>

    The application outputs an image (out_0.bmp) with detected faced enclosed in rectangles.

Congratulations, you have finished the OpenVINO™ toolkit for Raspbian* OS installation. You have completed all required installation, configuration and build steps in this guide.

Read the next topic if you want to learn more about OpenVINO workflow for Raspberry Pi.

Workflow for Raspberry Pi*

If you want to use your model for inference, the model must be converted to the .bin and .xml Intermediate Representation (IR) files that are used as input by Inference Engine. OpenVINO™ toolkit support on Raspberry Pi only includes the Inference Engine module of the Intel® Distribution of OpenVINO™ toolkit. The Model Optimizer is not supported on this platform. To get the optimized models you can use one of the following options: