You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Detailed explaination is available in [smartlab-action-recognition-0001-decoder](./smartlab-action-recognition-0001-decoder/README.md)
21
+
## Encoder model specification
18
22
23
+
The smartlab-action-recognition-encoder-0001 is a Mobilenet-V2 like backbone with convolutional encoder part of the action recognition.
24
+
25
+
To use both top-view and side-view features, there are two similar models called: `smartlab-action-recognition-0001-encoder-side` and `smartlab-action-recognition-0001-encoder-top`, which have the same strcuture but different weights.
26
+
27
+
| Metric | Value |
28
+
| ------- | ----- |
29
+
| GFlops | 0.611 |
30
+
| MParams | 3.387 |
31
+
32
+
### Inputs
33
+
34
+
Image, name: `input_image`, shape: `1, 3, 224, 224` in the `B, C, H, W` format, where:
35
+
36
+
-`B` - batch size
37
+
-`C` - number of channels
38
+
-`H` - image height
39
+
-`W` - image width
40
+
Expected color order is `BGR`
41
+
42
+
### Outputs
43
+
44
+
1. Name: `output_feature`, shape: `1, 1280`. Features from encoder part of action recogntion head.
45
+
46
+
## Decoder model specification
47
+
48
+
The smartlab-action-recognition-decoder-0001 is a fully connected decoder part which accepts features from top and front views, computed by encoder and predicts score for action across following label list: `no_action`, `noise_action`, `adjust_rider`
49
+
50
+
| Metric | Value |
51
+
| ------- | ----- |
52
+
| GFlops | 0.008 |
53
+
| MParams | 4.099 |
54
+
55
+
### Inputs
56
+
57
+
1. Name: `input_feature_1`, shape: `1, 1280`. Encoded features from topview.
58
+
2. Name: `input_feature_2`, shape: `1, 1280`. Encoded features from frontview.
0 commit comments