You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/audio-effects-detection.md
+17-13Lines changed: 17 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
title: Enable audio effects detection
3
3
description: Audio Effects Detection is one of Azure Video Indexer AI capabilities that detects various acoustics events and classifies them into different acoustic categories (for example, gunshot, screaming, crowd reaction and more).
4
4
ms.topic: how-to
5
-
ms.date: 01/04/2022
5
+
ms.date: 05/24/2023
6
6
ms.author: juliako
7
7
---
8
8
@@ -18,31 +18,36 @@ Some scenarios where this feature is useful:
18
18
19
19
## Supported audio categories
20
20
21
-
**Audio effect detection** can detect and classify 7 different categories. In the next table, you can find the different categories split in to the different presets, divided to **Standard** and **Advanced**. For more information, see [pricing](https://azure.microsoft.com/pricing/details/media-services/).
21
+
**Audio effect detection** can detect and classify different categories. In the following table, you can find the different categories split in to the different presets, divided to **Standard** and **Advanced**. For more information, see [pricing](https://azure.microsoft.com/pricing/details/video-indexer/).
22
+
23
+
The following table shows which categories are supported depending on **Preset Name** (**Audio Only** / **Video + Audio** vs. **Advance Audio** / **Advance Video + Audio**). When you are using the **Advanced** indexing, categories appear in the **Insights** pane of the website.
22
24
23
25
|Indexing type |Standard indexing| Advanced indexing|
The audio effects are retrieved in the insights JSON that includes the category ID, type, name, and set of instances per category along with their specific timeframe and confidence score.
38
-
39
-
The `name` parameter will be presented in the language in which the JSON was indexed, while the type will always remain the same.
45
+
The audio effects are retrieved in the insights JSON that includes the category ID, type, and set of instances per category along with their specific timeframe and confidence score.
40
46
41
47
```json
42
48
audioEffects: [{
43
49
id: 0,
44
50
type: "Gunshot or explosion",
45
-
name: "Gunshot",
46
51
instances: [{
47
52
confidence: 0.649,
48
53
adjustedStart: "0:00:13.9",
@@ -60,7 +65,6 @@ audioEffects: [{
60
65
}, {
61
66
id: 1,
62
67
type: "CrowdReactions",
63
-
name: "Crowd Reactions",
64
68
instances: [{
65
69
confidence: 0.6816,
66
70
adjustedStart: "0:00:47.9",
@@ -89,7 +93,7 @@ In order to set the index process to include the detection of audio effects, sel
89
93
90
94
## Closed Caption
91
95
92
-
When audio effects are retrieved in the closed caption files, they will be retrieved in square brackets the following structure:
96
+
When audio effects are retrieved in the closed caption files, they are retrieved in square brackets the following structure:
93
97
94
98
|Type| Example|
95
99
|---|---|
@@ -99,7 +103,7 @@ When audio effects are retrieved in the closed caption files, they will be retri
99
103
|TXT |[Gunshot or explosion]|
100
104
|CSV |0.9047,00:00:00.000,00:00:03.671, [Gunshot or explosion]|
101
105
102
-
Audio Effects in closed captions file will be retrieved with the following logic employed:
106
+
Audio Effects in closed captions file is retrieved with the following logic employed:
103
107
104
108
*`Silence` event type will not be added to the closed captions
105
109
* Maximum duration to show an event I 5 seconds
@@ -113,7 +117,7 @@ Audio effects can be added to the closed captions files supported by Azure Video
113
117
> :::image type="content" source="./media/audio-effects-detection/close-caption.jpg" alt-text="Audio Effects in CC":::
114
118
115
119
> [!NOTE]
116
-
> When using [update transcript](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Update-Video-Transcript) from closed caption files or [update custom language model](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Update-Language-Model) from closed caption files, audio effects included in those files will be ignored.
120
+
> When using [update transcript](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Update-Video-Transcript) from closed caption files or [update custom language model](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Update-Language-Model) from closed caption files, audio effects included in those files are ignored.
0 commit comments