common-sign-language-0001

## Use Case and High-Level Description

A human gesture recognition model for the Jester dataset recognition scenario (gesture-level recognition). The model uses an S3D framework with MobileNet V3 backbone. Please refer to the Jester dataset specification to see the list of gestures that are recognized by this model.

The model accepts a stack of frames (8 frames) sampled with a constant frame rate (15 FPS) and produces a prediction on the input clip.

## Specification

Metric Value
Top-1 accuracy (continuous Jester) 93.58%
GFlops 4.2269
MParams 4.1128
Source framework PyTorch*

## Input

### Original Model

Batch of images of the shape 1, 3, 8, 224, 224 in the B, C, T, H, W format, where:

• B - batch size
• C - channel
• T - sequence length
• H - height
• W - width

Channel order is RGB.

### Converted Model

Batch of images of the shape 1, 3, 8, 224, 224 in the B, C, T, H, W format, where:

• B - batch size
• C - channel
• T - sequence length
• H - height
• W - width

Channel order is RGB.

## Output

The model outputs a tensor with the shape B, 27, each row is a logits vector of performed Jester gestures.

### Original Model

Blob of the shape 1, 27 in the B, C format, where:

• B - batch size
• C - predicted logits size

### Converted Model

Blob of the shape 1, 27 in the B, C format, where:

• B - batch size
• C - predicted logits size

You can download models and if necessary convert them into Inference Engine format using the Model Downloader and other automation tools as shown in the examples below.