Overview of OpenVINO™ Toolkit Pre-Trained Models

OpenVINO™ toolkit distribution includes a set of pre-trained models that you can use for learning and demo purposes or for developing a deep learning software.

Object Detection Models

Several detection models can be used to detect a set of the most popular objects - for example, faces, people, vehicles. Most of the networks are SSD-based and provide reasonable accuracy/performance trade-offs. Networks that detect the same types of objects (for example, face-detection-adas-0001 and face-detection-retail-0004) provide a choice for higher accuracy/wider applicability at the cost of slower performance, so you can expect a "bigger" network to detect objects of the same type better.

Model Name Complexity (GFLOPs) Size (Mp) Face Person Vehicle Bike License plate
face-detection-adas-0001 2.835 1.053 X
face-detection-retail-0004 1.067 0.588 X
face-person-detection-retail-0002 2.757 0.791 X X
person-detection-retail-0002 12.427 3.244 X
person-detection-retail-0013 2.300 0.723 X
person-detection-action-recognition-0004 7.140 1.951 X
pedestrian-detection-adas-0002 2.836 1.165 X
pedestrian-and-vehicle-detector-adas-0001 3.974 1.650 X X
vehicle-detection-adas-0002 2.798 1.079 X
person-vehicle-bike-detection-crossroad-0078 3.964 1.178 X X X
vehicle-license-plate-detection-barrier-0106 0.349 0.634 X X

Object Recognition Models

Object recognition models are used for classification, regression, and character recognition. Use these networks after a respective detector (for example, Age/Gender recognition after Face Detection).

Model Name Complexity (GFLOPs) Size (Mp)
age-gender-recognition-retail-0013 0.094 2.138
head-pose-estimation-adas-0001 0.105 1.911
license-plate-recognition-barrier-0001 0.328 1.218
vehicle-attributes-recognition-barrier-0039 0.126 0.626
emotions-recognition-retail-0003 0.126 2.483
landmarks-regression-retail-0009 0.021 0.191
facial-landmarks-35-adas-0001 0.042 4.595
person-attributes-recognition-crossroad-0200 0.174 0.735

Reidentification Models

Precise tracking of objects in a video is a common application of Computer Vision (for example, for people counting). It is often complicated by a set of events that can be described as a "relatively long absence of an object". For example, it can be caused by occlusion or out-of-frame movement. In such cases, it is better to recognize the object as "seen before" regardless of its current position in an image or the amount of time passed since last known position.

The following networks can be used in such scenarios. They take an image of a person and evaluate an embedding - a vector in high-dimensional space that represents an appearance of this person. This vector can be used for further evaluation: images that correspond to the same person will have embedding vectors that are "close" by L2 metric (Euclidean distance).

There are multiple models that provide various trade-offs between performance and accuracy (expect a bigger model to perform better).

Model Name Complexity (GFLOPs) Size (Mp) Pairwise accuracy
person-reidentification-retail-0031 0.028 0.280 92.11%
person-reidentification-retail-0079 0.124 0.820 92.93%
person-reidentification-retail-0076 0.594 0.820 93.35%
face-reidentification-retail-0095 0.588 1.107 99.33%

Semantic Segmentation Models

Semantic segmentation is an extension of object detection problem. Instead of returning bounding boxes, semantic segmentation models return a "painted" version of the input image, where the "color" of each pixel represents a certain class. These networks are much bigger than respective object detection networks, but they provide a better (pixel-level) localization of objects and they can detect areas with complex shape (for example, free space on the road).

Model Name Complexity (GFLOPs) Size (Mp)
road-segmentation-adas-0001 4.770 0.184
semantic-segmentation-adas-0001 58.572 6.686

Human Pose Estimation Models

Human pose estimation task is to predict a pose: body skeleton, which consists of keypoints and connections between them, for every person in an input image or video. Keypoints are body joints, i.e. ears, eyes, nose, shoulders, knees, etc. There are two major groups of such metods: top-down and bottom-up. The first detects persons in a given frame, crops or rescales detections, then runs pose estimation network for every detection. These methods are very accurate. The second finds all keypoints in a given frame, then groups them by person instances, thus faster than previous, because network runs once.

Model Name Complexity (GFLOPs) Size (Mp)
human-pose-estimation-0001 15.435 4.099

Image Processing

Deep Learning models find their application in various image processing tasks to increase the quality of the output.

Model Name Complexity (GFLOPs) Size (Mp)
single-image-super-resolution-0063 39.713 0.363
single-image-super-resolution-1011 11.654 0.030
single-image-super-resolution-1021 16.062 0.030

Text Detection

Deep Learning models for text detection in various applications

Model Name Complexity (GFLOPs) Size (Mp)
text-detection-0001 51.256 6.747

Legal Information

[*] Other names and brands may be claimed as the property of others. [*] Other names and brands may be claimed as the property of others.