You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/audio-effects-detection-transparency-note.md
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ ms.date: 06/15/2022
10
10
ms.topic: article
11
11
---
12
12
13
-
# Audio effects detection - transparency note
13
+
# Audio effects detection
14
14
15
15
Audio effects detection is an Azure Video Indexer feature that detects insights on a variety of acoustic events and classifies them into acoustic categories. Audio effect detection can detect and classify different categories such as laughter, crowd reactions, alarms and/or sirens.
16
16
@@ -129,11 +129,11 @@ When used responsibly and carefully, Azure Video Indexer is a valuable tool for
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/face-detection.md
+21-21Lines changed: 21 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: Azure Video Indexer dace detection transparency note
2
+
title: Azure Video Indexer face detection transparency note
3
3
titleSuffix: Azure Video Indexer
4
-
description: This article gives an overview of a Azure Video Indexer face detection transparency note.
4
+
description: This article gives an overview of an Azure Video Indexer face detection transparency note.
5
5
author: juliako
6
6
ms.author: juliako
7
7
manager: femila
@@ -10,33 +10,33 @@ ms.date: 06/15/2022
10
10
ms.topic: article
11
11
---
12
12
13
-
# Face detection - transparency note
13
+
# Face detection
14
14
15
15
> [!IMPORTANT]
16
16
> Face identification, customization and celebrity recognition features access is limited based on eligibility and usage criteria in order to support our Responsible AI principles. Face identification, customization and celebrity recognition features are only available to Microsoft managed customers and partners. Use the [Face Recognition intake form](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUQjA5SkYzNDM4TkcwQzNEOE1NVEdKUUlRRCQlQCN0PWcu) to apply for access.
17
17
18
-
Face detection is an Azure Video Indexer AI feature that automatically detects faces in a media file and aggregates instances of similar faces into the same group. The celebrities recognition module is then run to recognize celebrities. This module covers approximately one million faces and is based on commonly requested data sources. Faces that are not recognized by Azure Video Indexer are still detected but are left unnamed. Customers can build their own custom [Person modules](/azure/azure-video-indexer/customize-person-model-overview) whereby the Azure Video Indexer recognizes faces that are not recognized by default.
18
+
Face detection is an Azure Video Indexer AI feature that automatically detects faces in a media file and aggregates instances of similar faces into the same group. The celebrities recognition module is then run to recognize celebrities. This module covers approximately one million faces and is based on commonly requested data sources. Faces that aren't recognized by Azure Video Indexer are still detected but are left unnamed. Customers can build their own custom [Person modules](/azure/azure-video-indexer/customize-person-model-overview) whereby the Azure Video Indexer recognizes faces that aren't recognized by default.
19
19
20
-
The resulting insights are generated in a categorized list in a JSON file which includes a thumbnail and either name or ID of each face. Clicking face’s thumbnail displays information like the name of the person (if they were recognized), the % of appearances in the video, and their biography if they are a celebrity. It also enables scrolling between the instances in the video.
20
+
The resulting insights are generated in a categorized list in a JSON file that includes a thumbnail and either name or ID of each face. Clicking face’s thumbnail displays information like the name of the person (if they were recognized), the % of appearances in the video, and their biography if they're a celebrity. It also enables scrolling between the instances in the video.
This transparency note discusses faces detection and the key considerations for making use of this technology responsibly. There are a number of things you need to consider when deciding how to use and implement an AI-powered feature:
28
+
This transparency note discusses faces detection and the key considerations for making use of this technology responsibly. There are many things you need to consider when deciding how to use and implement an AI-powered feature:
29
29
30
30
- Will this feature perform well in my scenario? Before deploying faces detection into your scenario, test how it performs using real-life data and make sure it can deliver the accuracy you need.
31
-
- Are we equipped to identify and respond to errors? AI-powered products and features will not be 100% accurate, so consider how you will identify and respond to any errors that may occur.
31
+
- Are we equipped to identify and respond to errors? AI-powered products and features won't be 100% accurate, so consider how you'll identify and respond to any errors that may occur.
32
32
33
33
## Key terms
34
34
35
35
|Term|Definition|
36
36
|---|---|
37
37
|Insight |The information and knowledge derived from the processing and analysis of video and audio files that generate different types of insights and can include detected objects, people, faces, animated characters, keyframes and translations or transcriptions. |
38
38
|Face recognition |The analysis of images to identify the faces that appear in the images. This process is implemented via the Azure Cognitive Services Face API. |
39
-
|Template |Enrolled images of people are converted to templates, which are then used for facial recognition. Machine-interpretable features are extracted from one or more images of an individual to create that individual’s template. The enrolment or probe images are not stored by Face API and the original images cannot be reconstructed based on a template. Template quality is a key determinant on the accuracy of your results. |
39
+
|Template |Enrolled images of people are converted to templates, which are then used for facial recognition. Machine-interpretable features are extracted from one or more images of an individual to create that individual’s template. The enrolment or probe images aren't stored by Face API and the original images can't be reconstructed based on a template. Template quality is a key determinant on the accuracy of your results. |
40
40
|Enrolment |The process of enrolling images of individuals for template creation so they can be recognized. When a person is enrolled to a verification system used for authentication, their template is also associated with a primary identifier2 that is used to determine which template to compare with the probe template. High-quality images and images representing natural variations in how a person looks (for instance wearing glasses, not wearing glasses) generate high-quality enrolment templates. |
41
41
|Deep search |The ability to retrieve only relevant video and audio files from a video library by searching for specific terms within the extracted insights.|
42
42
@@ -103,8 +103,8 @@ During the Faces Detection procedure, images in a media file are processed, as f
103
103
|---|---|
104
104
|Source file | The user uploads the source file for indexing. |
105
105
|Detection and aggregation |The face detector identifies the faces in each frame. The faces are then aggregated and grouped. |
106
-
|Recognition |The celebrities module runs over the aggregated groups to recognize celebrities. If the customer has created their own **persons** module it is also run to recognize people. When people are not recognized, they are labelled Unknown1, Unknown2 and so on. |
107
-
|Confidence value |Where applicable for well-known faces or faces identified in the customizable list, the estimated confidence level of each label is calculated as a range of 0 to 1. The confidence score represents the certainty in the accuracy of the result. For example, an 82% certainty will be represented as an 0.82 score.|
106
+
|Recognition |The celebrities module runs over the aggregated groups to recognize celebrities. If the customer has created their own **persons** module it's also run to recognize people. When people aren't recognized, they're labelled Unknown1, Unknown2 and so on. |
107
+
|Confidence value |Where applicable for well-known faces or faces identified in the customizable list, the estimated confidence level of each label is calculated as a range of 0 to 1. The confidence score represents the certainty in the accuracy of the result. For example, an 82% certainty is represented as an 0.82 score.|
108
108
109
109
## Example use cases
110
110
@@ -121,15 +121,15 @@ During the Faces Detection procedure, images in a media file are processed, as f
121
121
When used responsibly and carefully face detection is a valuable tool for many industries. To respect the privacy and safety of others, and to comply with local and global regulations, we recommend the following:
122
122
123
123
* Always respect an individual’s right to privacy, and only ingest videos for lawful and justifiable purposes.
124
-
* Do not purposely disclose inappropriate content about young children or family members of celebrities or other content that may be detrimental or pose a threat to an individual’s personal freedom.
124
+
* Don't purposely disclose inappropriate content about young children or family members of celebrities or other content that may be detrimental or pose a threat to an individual’s personal freedom.
125
125
* Commit to respecting and promoting human rights in the design and deployment of your analyzed media.
126
126
* When using 3rd party materials, be aware of any existing copyrights or permissions required before distributing content derived from them.
127
127
* Always seek legal advice when using content from unknown sources.
128
128
* Always obtain appropriate legal and professional advice to ensure that your uploaded videos are secured and have adequate controls to preserve the integrity of your content and to prevent unauthorized access.
129
129
* Provide a feedback channel that allows users and individuals to report issues with the service.
130
130
* Be aware of any applicable laws or regulations that exist in your area regarding processing, analyzing, and sharing media containing people.
131
-
* Keep a human in the loop. Do not use any solution as a replacement for human oversight and decision-making.
132
-
* Fully examine and review the potential of any AI model you are using to understand its capabilities and limitations.
131
+
* Keep a human in the loop. Don't use any solution as a replacement for human oversight and decision-making.
132
+
* Fully examine and review the potential of any AI model you're using to understand its capabilities and limitations.
133
133
134
134
## Next steps
135
135
@@ -146,11 +146,11 @@ When used responsibly and carefully face detection is a valuable tool for many i
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/keywords.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,13 +10,13 @@ ms.date: 06/15/2022
10
10
ms.topic: article
11
11
---
12
12
13
-
# Keywords extraction - transparency note
13
+
# Keywords extraction
14
14
15
15
Keywords extraction is an Azure Video Indexer AI feature that automatically detects insights on the different keywords discussed in media files. Keywords extraction can extract insights in both single language and multi-language media files. The total number of extracted keywords and their categories are listed in the Insights tab, where clicking a Keyword and then clicking Play Previous or Play Next jumps to the keyword in the media file.
0 commit comments