Skip to content

Commit c32ac16

Browse files
committed
add smartlab-action-recognition-0001 readme file.
1 parent a10f83c commit c32ac16

File tree

7 files changed

+130
-2
lines changed

7 files changed

+130
-2
lines changed

models/intel/device_support.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -140,5 +140,6 @@
140140
| smartlab-object-detection-0002 | YES | YES | |
141141
| smartlab-object-detection-0003 | YES | YES | |
142142
| smartlab-object-detection-0004 | YES | YES | |
143+
| smartlab-action-recognition-0001 | YES | YES | |
143144
| smartlab-sequence-modelling-0001 | YES | YES | |
144145
| smartlab-sequence-modelling-0002 | YES | YES | |

models/intel/index.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -475,8 +475,11 @@ Deep Learning models for online sequence modeling.
475475

476476
| Model Name | Complexity (GFLOPs) | Size (Mp) |
477477
|------------|---------------------|-----------|
478-
| [smartlab-sequence-modelling-0001](./smartlab-sequence-modelling-0001/README.md) | 0.049 | 1.02 |
479-
478+
| [smartlab-sequence-modelling-0001](./smartlab-sequence-modelling-0001/README.md) | 0.11 | 2.537 |
479+
| [smartlab-sequence-modelling-0002](./smartlab-sequence-modelling-0002/README.md) | 0.049 | 1.02 |
480+
| [smartlab-action-recognition-0001](./smartlab-action-recognition-0001/README.md) | - | - |
481+
| smartlab-action-recognition-encoder-0001 | 0.611 | 3.387 |
482+
| smartlab-action-recognition-decoder-0001 | 0.008 | 4.099 |
480483
## See Also
481484

482485
* [Open Model Zoo Demos](../../demos/README.md)
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
# smartlab-action-recognition-0001 (composite)
2+
3+
## Use Case and High-Level Description
4+
5+
This is an smartlab action recogntion model that recognizes smartlab actions.
6+
The model uses smartlab dataset to predict actions.
7+
The model is classfier for 3 class actions.
8+
9+
## Example of the input data
10+
![](./assets/frame0001.jpg)
11+
12+
## Example of the output
13+
Name: `decoder_hidden`, shape: `1, 3`. The foramt is:
14+
15+
[`has_action_conf_score`, `action_1_logits`, `action_2_logits`].
16+
17+
Detailed explaination is available in [smartlab-action-recognition-0001-decoder](./smartlab-action-recognition-0001-decoder/README.md)
18+
19+
20+
## Legal Information
21+
22+
[*] Other names and brands may be claimed as the property of others.
41 KB
Loading
Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# smartlab-action-recognition-0001 (decoder)
2+
3+
## Use Case and High-Level Description
4+
5+
This is the decoder part of smartlab action recogntion model.
6+
7+
This model classifies action from noise_action, put_take and adjust_rider.
8+
9+
## Decoder model specification
10+
11+
The smartlab-action-recognition-decoder-0001 is a fully connected decoder part which accepts features from top and front views, computed by encoder and predicts score for action across following label list: `no_action`, `noise_action`, `adjust_rider`
12+
13+
| Metric | Value |
14+
| ------- | ----- |
15+
| GFlops | 0.008 |
16+
| MParams | 4.099 |
17+
18+
### Inputs
19+
20+
1. Name: `input_feature_1`, shape: `1, 1280`. Encoded features from topview.
21+
2. Name: `input_feature_2`, shape: `1, 1280`. Encoded features from frontview.
22+
23+
### Outputs
24+
25+
1. Name: `decoder_hidden`, shape: `1, 3`. The foramt [`has_action_conf_score`, `action_1_logits`, `action_2_logits`]
26+
* `has_action_conf_score` - confidence for action frame. If>0.5, there is specified action.
27+
* `action_1_logits` - confidence for the put_take action class
28+
* `action_2_logits` - confidence for the adjust_rider action class
29+
30+
Classification confidence scores in the [0, 1] range.
31+
32+
## Legal Information
33+
34+
[*] Other names and brands may be claimed as the property of others.
Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# smartlab-action-recognition-0001 (encoder-side)
2+
3+
## Use Case and High-Level Description
4+
5+
This is the encoder-side part of smartlab action recogntion model.
6+
7+
This model encodes the side-view of image frame into feature vector.
8+
9+
## Encoder model specification
10+
11+
The smartlab-action-recognition-encoder-0001 is a Mobilenet-V2 like backbone with convolutional encoder part of the action recognition.
12+
13+
| Metric | Value |
14+
| ------- | ----- |
15+
| GFlops | 0.611 |
16+
| MParams | 3.387 |
17+
18+
### Inputs
19+
20+
Image, name: `input_image`, shape: `1, 3, 224, 224` in the `B, C, H, W` format, where:
21+
22+
- `B` - batch size
23+
- `C` - number of channels
24+
- `H` - image height
25+
- `W` - image width
26+
Expected color order is `BGR`
27+
28+
### Outputs
29+
30+
1. Name: `output_feature`, shape: `1, 1280`. Features from encoder part of action recogntion head.
31+
32+
## Legal Information
33+
34+
[*] Other names and brands may be claimed as the property of others.
Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# smartlab-action-recognition-0001 (encoder-top)
2+
3+
## Use Case and High-Level Description
4+
5+
This is the encoder-top part of smartlab action recogntion model.
6+
7+
This model encodes the top-view of image frame into feature vector.
8+
9+
## Encoder model specification
10+
11+
The smartlab-action-recognition-encoder-0001 is a Mobilenet-V2 like backbone with convolutional encoder part of the action recognition.
12+
13+
| Metric | Value |
14+
| ------- | ----- |
15+
| GFlops | 0.611 |
16+
| MParams | 3.387 |
17+
18+
### Inputs
19+
20+
Image, name: `input_image`, shape: `1, 3, 224, 224` in the `B, C, H, W` format, where:
21+
22+
- `B` - batch size
23+
- `C` - number of channels
24+
- `H` - image height
25+
- `W` - image width
26+
Expected color order is `BGR`
27+
28+
### Outputs
29+
30+
1. Name: `output_feature`, shape: `1, 1280`. Features from encoder part of action recogntion head.
31+
32+
## Legal Information
33+
34+
[*] Other names and brands may be claimed as the property of others.

0 commit comments

Comments
 (0)