Skip to content

Commit e53f59a

Browse files
committed
added indexing config guide
1 parent 21a70c6 commit e53f59a

File tree

4 files changed

+125
-2
lines changed

4 files changed

+125
-2
lines changed
Lines changed: 121 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,121 @@
1+
---
2+
title: Indexing configuration guide
3+
description: This article provides a guide on indexing configuration options.
4+
ms.topic: conceptual
5+
ms.date: 10/26/2022
6+
ms.author: juliako
7+
---
8+
9+
# Indexing configuration guide
10+
11+
When indexing videos, users can use the default settings but also have the option of adjusting many of the settings. It's important to understand the configuration options to index efficiently while ensuring you meet your indexing objectives. Video Indexer allows you to choose between a range of language, indexing, custom models, and streaming settings that have implications on the insights generated, cost, and performance.
12+
13+
This article will explain each of the options and the impact of each option to enable informed decisions when indexing. It discusses the Video Indexer portal experience but the same options apply when submitting jobs through the API – see [API guide](video-indexer-use-apis.md) and the [at-scale guide](considerations-when-use-at-scale.md) for what to consider when indexing large volumes.
14+
15+
The initial upload screen presents options to define the video name, source language, and privacy settings.
16+
17+
:::image type="content" source="./media/indexing-configuration-guide/configuration.png" alt-text="The screen presents options to define the video name, source language, and privacy settings.
18+
":::
19+
20+
All the other setting options appear if you select Advanced options.
21+
22+
:::image type="content" source="./media/indexing-configuration-guide/advanced-configuration.png" alt-text="The screen presents advanced options to define the video name, source language, and privacy settings.
23+
":::
24+
25+
## Video source language
26+
27+
If you're aware of the language spoken in the video, select the language from the Video source language list. If you're unsure of the language of the video, choose **Auto-detect single language** when uploading and indexing your video and Video Indexer will use language identification (LID) to detect the videos language and generate transcription and insights with the detected language. If the video may contain multiple languages and you aren't sure which ones, select **Auto-detect multi-language** and multi-language (MLID) detection will be applied when uploading and indexing your video.
28+
29+
While auto-detect is a great option when the language in your videos varies, there are two points to consider when using LID or MLID:
30+
31+
- LID/MLID don't support all the languages supported by Video Indexer
32+
- The transcription is of a higher quality when you pre-select the video’s appropriate language
33+
34+
Learn more about [language support and supported languages](language-support.md).
35+
36+
### Privacy
37+
38+
This allows you to determine if the insights should only be accessible to users in your Video Indexer account or to anyone with a link.
39+
40+
### Indexing options
41+
42+
When indexing a video, default settings are applied (see end of the doc for information on default settings). Each of the audio and video indexing options may be priced differently. See the [Azure Video Indexer pricing](https://azure.microsoft.com/pricing/details/video-indexer/) page for details.
43+
44+
Below are the indexing type options with details of their insights provided. To modify the Indexing type, select Advanced settings and go to Video + audio indexing.
45+
46+
|Audio only|Video only |Audio & Video
47+
|---|---|---|
48+
|Basic |||
49+
|Standard| Standard |Standard |
50+
|Advanced |Advanced|Advanced |
51+
52+
### Audio only
53+
54+
Basic - Indexes and extract insights by using audio only (ignoring video) and provides the following insights: transcription, translation, formatting of output captions and subtitles, named entities (brands, locations, people), and topics.
55+
56+
Standard - Indexes and extract insights by using audio only (ignoring video) and provides the following insights: transcription, translation, formatting of output captions and subtitles, emotions, keywords, named entities (brands, locations, people), sentiments, speakers, and topics.
57+
58+
Advanced - Indexes and extract insights by using audio only (ignoring video) and provides the following insights: transcription, translation, formatting of output captions and subtitles, audio effects (preview), emotions, keywords, named entities (brands, locations, people), sentiments, speakers, and articles.
59+
60+
Video only
61+
62+
Standard - Indexes and extract insights by using video only (ignoring audio) and provides the following insights: labels (OCR), named entities (OCR - brands, locations, people), OCR, people, scenes (keyframes and shots), and topics (OCR).
63+
64+
Advanced - Indexes and extract insights by using video only (ignoring audio) and provides the following insights: labels (OCR), matched person (preview), named entities (OCR - brands, locations, people), OCR, observed people (preview), people, scenes (keyframes and shots), and topics (OCR).
65+
66+
Audio and Video
67+
68+
Standard - Indexes and extract insights by using audio and video and provides the following insights: transcription, translation, formatting of output captions and subtitles, audio effects (preview), emotions, keywords, named entities (brands, locations, people), OCR, people, sentiments, speakers, and topics.
69+
70+
Advanced - Indexes and extract insights by using audio and video and provides the following insights: transcription, translation, formatting of output captions and subtitles, audio effects (preview), emotions, keywords, matched person (preview), named entities (brands, locations, people), OCR, observed people (preview), people, sentiments, speakers, and topics.
71+
72+
Streaming quality options
73+
74+
When indexing a video, you can decide if encoding of the file should occur which will enable streaming. The sequence is as follows:
75+
76+
Upload > Encode (optional) > Index & Analysis > Publish for streaming (optional)
77+
78+
Encoding and streaming operations are performed by and billed by Azure Media Services. There are more operations associated with creation of a streaming video; a Streaming Endpoint and the egress traffic that depends on the number of video playbacks, video playback length, and the video quality (bitrate).
79+
80+
There are several aspects that influence the total costs of the encoding job. The first is if the encoding is with single or adaptive streaming. This will create either a single output or multiple encoding quality outputs. Each output is billed separately and depends on the source quality of the video you uploaded to Video Indexer.
81+
82+
See the Media Service pricing page for encoding pricing details.
83+
84+
When indexing a video, default streaming settings are applied (see below for information on default settings). Below are the streaming type options that can be modified if you, select Advanced settings and go to Streaming quality.
85+
86+
}Single bitrate|Adaptive bitrate| No streaming |
87+
88+
Single bitrate
89+
90+
With Single Bitrate, the standard Media Services encoder cost will apply for the output. If the video height is greater than or equal to 720p HD, Azure Video Indexer encodes it with a resolution of 1280 x 720. Otherwise, it's encoded as 640 x 468. The default setting is content-aware encoding.
91+
92+
Adaptive bitrate
93+
94+
With Adaptive Bitrate, if you upload a video in 720p HD single bitrate to Video Indexer and select Adaptive Bitrate, the encoder will use AdaptiveStreaming preset. An output of 720p HD (no output exceeding 720p HD is created) and several lower quality outputs are created (for playback on smaller screens/low bandwidth environments). Each output will use the Media Encoder Standard base price and apply a multiplier for each output. The multiplier is 2x for HD, 1x for non-HD, and .25 for audio and billing is per minute of the input video.
95+
96+
Example: If you index a video in the US East region that is 40 minutes in length and is 720p HP and have selecting the streaming option of Adaptive Bitrate, 3 outputs will be created - 1 HD (multiplied by 2), 1 SD (multiplied by 1) and 1 audio track (multiplied by 0.25). This will total to (2+1+0.25) * 40 = 130 billable output minutes.
97+
98+
Output minutes (standard encoder): 130 x $0.015/minute = $1.95
99+
100+
No streaming
101+
102+
Insights are generated but no streaming operation is performed and the video isn't available on the Video Indexer website. When No streaming is selected, you aren't billed for encoding.
103+
104+
Customizing content models - People/Animated characters and Brand categories
105+
106+
Azure Video Indexer allows you to customize some of its models to be adapted to your specific use case. These models include animated characters, brands, language, and person. If you have customized models, this section enables you to configure if one of the created models should be used for the indexing.
107+
108+
Default Settings
109+
110+
By default, Video Indexer is configured to a Video source language of English, Privacy of private, Standard audio and video setting, and Streaming quality of single bitrate.
111+
112+
Below are a few examples of when using the default setting might not be a good fit:
113+
114+
- If you need insights observed people or matched person that is only available through Advanced Video.
115+
- If you're only using Video Indexer for transcription and translation, indexing of both Audio & Video isn’t required, Basic audio should suffice.
116+
- If you're consuming Video Indexer insights but have no need to generate a new media file, streaming isn’t necessary and No streaming should be selected to avoid the encoding job and its associated cost.
117+
- If a video is primarily in a language that isn't English.
118+
119+
## Next steps
120+
121+
Learn more about [language support and supported languages](language-support.md).
15.9 KB
Loading
6.77 KB
Loading

articles/azure-video-indexer/toc.yml

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -42,8 +42,8 @@
4242
items:
4343
- name: Terminology & concepts overview
4444
href: concepts-overview.md
45-
- name: Compare Azure Video Indexer and Media Services presets
46-
href: compare-video-indexer-with-media-services-presets.md
45+
- name: Indexing configuration guide
46+
href: indexing-configuration-guide.md
4747
- name: Manage multiple tenants
4848
href: manage-multiple-tenants.md
4949
- name: Using at scale
@@ -92,6 +92,8 @@
9292
items:
9393
- name: Slate detection
9494
href: slate-detection-insight.md
95+
- name: Compare Azure Video Indexer and Media Services presets
96+
href: compare-video-indexer-with-media-services-presets.md
9597
- name: How to guides
9698
items:
9799
- name: Manage accounts

0 commit comments

Comments
 (0)