Skip to content

Commit 21e3224

Browse files
committed
fix according to comments.
1 parent 991942f commit 21e3224

File tree

8 files changed

+60
-108
lines changed

8 files changed

+60
-108
lines changed

models/intel/index.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -477,9 +477,10 @@ Deep Learning models for online sequence modeling.
477477
|------------|---------------------|-----------|
478478
| [smartlab-sequence-modelling-0001](./smartlab-sequence-modelling-0001/README.md) | 0.11 | 2.537 |
479479
| [smartlab-sequence-modelling-0002](./smartlab-sequence-modelling-0002/README.md) | 0.049 | 1.02 |
480-
| [smartlab-action-recognition-0001](./smartlab-action-recognition-0001/README.md) | - | - |
481-
| smartlab-action-recognition-encoder-0001 | 0.611 | 3.387 |
482-
| smartlab-action-recognition-decoder-0001 | 0.008 | 4.099 |
480+
| [smartlab-action-recognition-0001](./smartlab-action-recognition-0001/README.md) | | |
481+
| smartlab-action-recognition-0001-encoder-side | 0.611 | 3.387 |
482+
| smartlab-action-recognition-0001-encoder-top | 0.611 | 3.387 |
483+
| smartlab-action-recognition-0001-decoder | 0.008 | 4.099 |
483484
## See Also
484485

485486
* [Open Model Zoo Demos](../../demos/README.md)

models/intel/smartlab-action-recognition-0001/README.md

Lines changed: 56 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,65 @@ These models are fine-tuned with smartlab dataset to predict actions and can cla
1010
![](./assets/frame0001.jpg)
1111

1212
## Example of the output
13-
Name: `decoder_hidden`, shape: `1, 3`. The foramt is:
13+
Output `put_take` action
1414

15-
[`has_action_conf_score`, `action_1_logits`, `action_2_logits`].
15+
## Composite model specification
16+
| Metric | Value |
17+
| ---------------------------------------------- | ------------------ |
18+
| Accuracy on the DSI1867 | TODO |
19+
| Source framework | PyTorch\* |
1620

17-
Detailed explaination is available in [smartlab-action-recognition-0001-decoder](./smartlab-action-recognition-0001-decoder/README.md)
21+
## Encoder model specification
1822

23+
The smartlab-action-recognition-encoder-0001 is a Mobilenet-V2 like backbone with convolutional encoder part of the action recognition.
24+
25+
To use both top-view and side-view features, there are two similar models called: `smartlab-action-recognition-0001-encoder-side` and `smartlab-action-recognition-0001-encoder-top`, which have the same strcuture but different weights.
26+
27+
| Metric | Value |
28+
| ------- | ----- |
29+
| GFlops | 0.611 |
30+
| MParams | 3.387 |
31+
32+
### Inputs
33+
34+
Image, name: `input_image`, shape: `1, 3, 224, 224` in the `B, C, H, W` format, where:
35+
36+
- `B` - batch size
37+
- `C` - number of channels
38+
- `H` - image height
39+
- `W` - image width
40+
Expected color order is `BGR`
41+
42+
### Outputs
43+
44+
1. Name: `output_feature`, shape: `1, 1280`. Features from encoder part of action recogntion head.
45+
46+
## Decoder model specification
47+
48+
The smartlab-action-recognition-decoder-0001 is a fully connected decoder part which accepts features from top and front views, computed by encoder and predicts score for action across following label list: `no_action`, `noise_action`, `adjust_rider`
49+
50+
| Metric | Value |
51+
| ------- | ----- |
52+
| GFlops | 0.008 |
53+
| MParams | 4.099 |
54+
55+
### Inputs
56+
57+
1. Name: `input_feature_1`, shape: `1, 1280`. Encoded features from topview.
58+
2. Name: `input_feature_2`, shape: `1, 1280`. Encoded features from frontview.
59+
60+
### Outputs
61+
62+
1. Name: `decoder_hidden`, shape: `1, 3`. The foramt [`has_action_conf_score`, `action_1_logits`, `action_2_logits`]
63+
* `has_action_conf_score` - confidence for action frame. If>0.5, there is specified action.
64+
* `action_1_logits` - confidence for the put_take action class
65+
* `action_2_logits` - confidence for the adjust_rider action class
66+
67+
Classification confidence scores in the [0, 1] range.
68+
## Demo usage
69+
The model can be used in the following demos provided by the Open Model Zoo to show its capabilities:
70+
71+
- [smartlab_demo/python](../../../demos/smartlab_demo/python/README.md)
1972

2073
## Legal Information
2174

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-decoder/.gitkeep

Whitespace-only changes.

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-decoder/README.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-encoder-side/.gitkeep

Whitespace-only changes.

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-encoder-side/README.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-encoder-top/.gitkeep

Whitespace-only changes.

models/intel/smartlab-action-recognition-0001/smartlab-action-recognition-0001-encoder-top/README.md

Lines changed: 0 additions & 34 deletions
This file was deleted.

0 commit comments

Comments
 (0)