You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/media-services/video-indexer/scenes-shots-keyframes.md
+30-27Lines changed: 30 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -34,32 +34,6 @@ Video Indexer determines when a shot changes in the video based on visual cues,
34
34
35
35
Selects the frame(s) that best represent the shot. Keyframes are the representative frames selected from the entire video based on aesthetic properties (for example, contrast and stableness). Video Indexer retrieves a list of keyframe IDs as part of the shot's metadata, based on which customers can extract the keyframe thumbnail.
36
36
37
-
Keyframes are associated with shots in the output JSON.
38
-
39
-
## Editorial shot type detection
40
-
41
-
The shot type associated with an individual shot in the insights JSON represents its editorial type. You may find these shot type characteristics useful when editing videos into clips, trailers, or when searching for a specific style of keyframe for artistic purposes. The different types are determined based on analysis of the first keyframe of each shot. Shots are identified by the scale, size, and location of the faces appearing in their first keyframe.
42
-
43
-
The shot size and scale are determined based on the distance between the camera and the faces appearing in the frame. Using these properties, Video Indexer detects the following shot types:
44
-
45
-
* Wide: shows an entire person’s body.
46
-
* Medium: shows a person's upper-body and face.
47
-
* Close up: mainly shows a person’s face.
48
-
* Extreme close-up: shows a person’s face filling the screen.
49
-
50
-
Shot types can also be determined by location of the subject characters with respect to the center of the frame. This property defines the following shot types in Video Indexer:
51
-
52
-
* Left face: a person appears in the left side of the frame.
53
-
* Center face: a person appears in the central region of the frame.
54
-
* Right face: a person appears in the right side of the frame.
55
-
* Outdoor: a person appears in an outdoor setting.
56
-
* Indoor: a person appears in an indoor setting.
57
-
58
-
Additional characteristics:
59
-
60
-
* Two shots: shows two persons’ faces of medium size.
61
-
* Multiple faces: more than two persons.
62
-
63
37
## Extracting Keyframes
64
38
65
39
To extract high-resolution keyframes for your video, you must first upload and index the video.
@@ -78,7 +52,7 @@ Unzip and open the folder. In the *_KeyframeThumbnail* folder, and you will find
78
52
79
53
To get keyframes using the Video Indexer API, upload and index your video using the [Upload Video](https://api-portal.videoindexer.ai/docs/services/Operations/operations/Upload-Video?) call. Once the indexing job is complete, call [Get Video Index](https://api-portal.videoindexer.ai/docs/services/Operations/operations/Get-Video-Index?). This will give you all of the insights that Video Indexer extracted from your content in a JSON file.
80
54
81
-
You will get a list of keyframe IDs as part of each shot's metadata. You will now need to run each of these keyframe IDs on the [Get Thumbnails](https://api-portal.videoindexer.ai/docs/services/Operations/operations/Get-Video-Thumbnail?) call. This will download each of the keyframe images to your computer.
55
+
You will get a list of keyframe IDs as part of each shot's metadata.
82
56
83
57
```json
84
58
"shots":[
@@ -120,6 +94,35 @@ You will get a list of keyframe IDs as part of each shot's metadata. You will no
120
94
]
121
95
```
122
96
97
+
You will now need to run each of these keyframe IDs on the [Get Thumbnails](https://api-portal.videoindexer.ai/docs/services/Operations/operations/Get-Video-Thumbnail?) call. This will download each of the keyframe images to your computer.
98
+
99
+
## Editorial shot type detection
100
+
101
+
Keyframes are associated with shots in the output JSON.
102
+
103
+
The shot type associated with an individual shot in the insights JSON represents its editorial type. You may find these shot type characteristics useful when editing videos into clips, trailers, or when searching for a specific style of keyframe for artistic purposes. The different types are determined based on analysis of the first keyframe of each shot. Shots are identified by the scale, size, and location of the faces appearing in their first keyframe.
104
+
105
+
The shot size and scale are determined based on the distance between the camera and the faces appearing in the frame. Using these properties, Video Indexer detects the following shot types:
106
+
107
+
* Wide: shows an entire person’s body.
108
+
* Medium: shows a person's upper-body and face.
109
+
* Close up: mainly shows a person’s face.
110
+
* Extreme close-up: shows a person’s face filling the screen.
111
+
112
+
Shot types can also be determined by location of the subject characters with respect to the center of the frame. This property defines the following shot types in Video Indexer:
113
+
114
+
* Left face: a person appears in the left side of the frame.
115
+
* Center face: a person appears in the central region of the frame.
116
+
* Right face: a person appears in the right side of the frame.
117
+
* Outdoor: a person appears in an outdoor setting.
118
+
* Indoor: a person appears in an indoor setting.
119
+
120
+
Additional characteristics:
121
+
122
+
* Two shots: shows two persons’ faces of medium size.
123
+
* Multiple faces: more than two persons.
124
+
125
+
123
126
## Next steps
124
127
125
128
[Examine the Video Indexer output produced by the API](video-indexer-output-json-v2.md#scenes)
0 commit comments