You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/face-detection.md
+17-15Lines changed: 17 additions & 15 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,24 +12,24 @@ ms.topic: article
12
12
13
13
# Face detection
14
14
15
-
Face detection, a feature of Azure AI Video Indexer, automatically detects faces in a media file, and then aggregates instances of similar faces into a group. The celebrities recognition module then runs to recognize celebrities.
15
+
Face detection, a feature of Azure AI Video Indexer, automatically detects faces in a media file, and then aggregates instances of similar faces into groups. The celebrities recognition model then runs to recognize celebrities.
16
16
17
-
The celebrities recognition model covers approximately one million faces and is based on commonly requested data sources. Faces that Video Indexer doesn't recognize as celebrities are still detected but are left unnamed. You can build your own custom [person model](/azure/azure-video-indexer/customize-person-model-overview) to train Video Indexer to recognize faces that aren't recognized by default.
17
+
The celebrities recognition model covers approximately 1 million faces and is based on commonly requested data sources. Faces that Video Indexer doesn't recognize as celebrities are still detected but are left unnamed. You can build your own custom [person model](/azure/azure-video-indexer/customize-person-model-overview) to train Video Indexer to recognize faces that aren't recognized by default.
18
18
19
-
Face detection insights are generated in a categorized list in a JSON file that includes a thumbnail and either a name or an ID for each face. Selecting a face’s thumbnail displays information like the name of the person (if they were recognized), the percentage of instances the person appears in the video, and the person's biography, if they're a celebrity. You can also scroll between instances in the video where the face appears.
19
+
Face detection insights are generated as a categorized list in a JSON file that includes a thumbnail and either a name or an ID for each face. Selecting a face’s thumbnail displays information like the name of the person (if they were recognized), the percentage of the video that the person appears, and the person's biography, if they're a celebrity. You can also scroll between instances in the video where the person appears.
20
20
21
21
> [!IMPORTANT]
22
-
> To support Microsoft Responsible AI principles, access to the face identification, customization, and celebrity recognition features is limited and based on eligibility and usage criteria. Face identification, customization, and celebrity recognition features are available to Microsoft managed customers and partners. To apply for access, use the [facial recognition intake form](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUQjA5SkYzNDM4TkcwQzNEOE1NVEdKUUlRRCQlQCN0PWcu).
22
+
> To support Microsoft Responsible AI principles, access to face identification, customization, and celebrity recognition features is limited and based on eligibility and usage criteria. Face identification, customization, and celebrity recognition features are available to Microsoft managed customers and partners. To apply for access, use the [facial recognition intake form](https://customervoice.microsoft.com/Pages/ResponsePage.aspx?id=v4j5cvGGr0GRqy180BHbR7en2Ais5pxKtso_Pz4b1_xUQjA5SkYzNDM4TkcwQzNEOE1NVEdKUUlRRCQlQCN0PWcu).
23
23
24
24
## Prerequisites
25
25
26
-
Review [Transparency Note for Azure Video Indexer](/legal/azure-video-indexer/transparency-note?context=/azure/azure-video-indexer/context/context).
26
+
Review [Transparency Note for Azure AI Video Indexer](/legal/azure-video-indexer/transparency-note?context=/azure/azure-video-indexer/context/context).
27
27
28
28
## General principles
29
29
30
30
This article discusses face detection and key considerations for using this technology responsibly. You need to consider many important factors when you decide how to use and implement an AI-powered feature, including:
31
31
32
-
- Will this feature perform well in your scenario? Before you deploy face detection in your scenario, test how it performs by using real-life data. Make make sure that it can deliver the accuracy you need.
32
+
- Will this feature perform well in your scenario? Before you deploy face detection in your scenario, test how it performs by using real-life data. Make sure that it can deliver the accuracy you need.
33
33
- Are you equipped to identify and respond to errors? AI-powered products and features aren't 100 percent accurate, so consider how you'll identify and respond to any errors that occur.
34
34
35
35
## Key terms
@@ -38,19 +38,21 @@ This article discusses face detection and key considerations for using this tech
38
38
|---|---|
39
39
| insight | The information and knowledge that you derive from processing and analyzing video and audio files. The insight can include detected objects, people, faces, keyframes, and translations or transcriptions. |
40
40
| face recognition | Analyzing images to identify the faces that appear in the images. This process is implemented via the Azure AI Face API. |
41
-
| template | Enrolled images of people are converted to templates, which are then used for facial recognition. Machine-interpretable features are extracted from one or more images of an individual to create that individual’s template. The enrollment or probe images aren't stored by the Face API, and the original images can't be reconstructed based on a template. Template quality is a key determinant on the accuracy of your results. |
41
+
| template | Enrolled images of people are converted to templates, which are then used for facial recognition. Machine-interpretable features are extracted from one or more images of an individual to create that individual’s template. The enrollment or probe images aren't stored by the Face API, and the original images can't be reconstructed based on a template. Template quality is a key determinant for accuracy in your results. |
42
42
| enrollment | The process of enrolling images of individuals for template creation so that they can be recognized. When a person is enrolled to a verification system that's used for authentication, their template is also associated with a primary identifier that's used to determine which template to compare against the probe template. High-quality images and images that represent natural variations in how a person looks (for instance, wearing glasses and not wearing glasses) generate high-quality enrollment templates. |
43
43
| deep search | The ability to retrieve only relevant video and audio files from a video library by searching for specific terms within the extracted insights.|
44
44
45
45
## View insights
46
46
47
47
To see face detection instances on the Azure AI Video Indexer website:
48
48
49
-
1. When you upload the media file, go to **Video + Audio Indexing**, **Audio Only**, or **Video + Audio**. Then select **Advanced**.
49
+
1. When you upload the media file, in the **Upload and index** dialog, select **Advanced settings**.
50
+
1. On the left menu, select **People models**. Select a model to apply to the media file.
50
51
1. After the file is uploaded and indexed, go to **Insights** and scroll to **People**.
51
52
52
-
To see face detection insight in the JSON file:
53
+
To see face detection insights in a JSON file:
53
54
55
+
1. On the Azure AI Video Indexer website, open the uploaded video.
54
56
1. Select **Download** > **Insights (JSON)**.
55
57
1. Under `insights`, copy the `faces` element and paste it into your JSON viewer.
56
58
@@ -98,7 +100,7 @@ To see face detection insight in the JSON file:
98
100
To download the JSON file via the API, go to the [Azure AI Video Indexer developer portal](https://api-portal.videoindexer.ai/).
99
101
100
102
> [!IMPORTANT]
101
-
> When you review face detections in the UI, you might not see all faces. We expose only face groups that have a confidence of more than 0.5, and the face must appear for a minimum of 4 seconds or 10 percent of the value of `video_duration`. Only when these conditions are met do we show the face in the UI and the *Insights.json* file. You can always retrieve all face instances from the face artifact file by using the API `https://api.videoindexer.ai/{location}/Accounts/{accountId}/Videos/{videoId}/ArtifactUrl[?Faces][&accessToken]`.
103
+
> When you review face detections in the UI, you might not see all faces that appear in the video. We expose only face groups that have a confidence of more than 0.5, and the face must appear for a minimum of 4 seconds or 10 percent of the value of `video_duration`. Only when these conditions are met do we show the face in the UI and in the *Insights.json* file. You can always retrieve all face instances from the face artifact file by using the API: `https://api.videoindexer.ai/{location}/Accounts/{accountId}/Videos/{videoId}/ArtifactUrl[?Faces][&accessToken]`.
102
104
103
105
## Face detection components
104
106
@@ -108,8 +110,8 @@ The following table describes how images in a media file are processed during th
108
110
|---|---|
109
111
| source file | The user uploads the source file for indexing. |
110
112
| detection and aggregation | The face detector identifies the faces in each frame. The faces are then aggregated and grouped. |
111
-
| recognition | The celebrities model runs over the aggregated groups to recognize celebrities. If the customer has created their own person model, it also runs to recognize other people. If people aren't recognized, they're labeled Unknown1, Unknown2, and so on. |
112
-
| confidence value | Where applicable for well-known faces or faces that are identified in the customizable list, the estimated confidence level of each label is calculated as a range of 0 to 1. The confidence score represents the certainty in the accuracy of the result. For example, an 82 percent certainty is represented as an 0.82 score.|
113
+
| recognition | The celebrities model processes the aggregated groups to recognize celebrities. If you've created your own people model, it also processes groups to recognize other people. If people aren't recognized, they're labeled Unknown1, Unknown2, and so on. |
114
+
| confidence value | Where applicable for well-known faces or for faces that are identified in the customizable list, the estimated confidence level of each label is calculated as a range of 0 to 1. The confidence score represents the certainty in the accuracy of the result. For example, an 82 percent certainty is represented as an 0.82 score.|
113
115
114
116
## Example use cases
115
117
@@ -125,15 +127,15 @@ Face detection is a valuable tool for many industries when it's used responsibly
125
127
126
128
- Carefully consider the accuracy of the results. To promote more accurate detection, check the quality of the video. Low-quality video might affect the insights that are presented.
127
129
- Carefully review results if you use face detection for law enforcement. People might not be detected if they're small, sitting, crouching, or obstructed by objects or other people. To ensure fair and high-quality decisions, combine face detection-based automation with human oversight.
128
-
- Don't use face detection for decisions that might have serious, adverse impacts. Decisions that are based on incorrect output can have serious, adverse impacts. Also, it's advisable to include human review of decisions that have the potential for serious impacts on individuals.
130
+
- Don't use face detection for decisions that might have serious, adverse impacts. Decisions that are based on incorrect output can have serious, adverse impacts. It's advisable to include human review of decisions that have the potential for serious impacts on individuals.
129
131
- Always respect an individual’s right to privacy, and ingest videos only for lawful and justifiable purposes.
130
132
- Don't purposely disclose inappropriate content about young children, family members of celebrities, or other content that might be detrimental to or pose a threat to an individual’s personal freedom.
131
133
- Commit to respecting and promoting human rights in the design and deployment of your analyzed media.
132
134
- If you use third-party materials, be aware of any existing copyrights or required permissions before you distribute content that's derived from them.
133
135
- Always seek legal advice if you use content from an unknown source.
134
-
- Always obtain appropriate legal and professional advice to ensure that your uploaded videos are secured, and that they have adequate controls to preserve the integrity of your content and prevent unauthorized access.
136
+
- Always obtain appropriate legal and professional advice to ensure that your uploaded videos are secured and that they have adequate controls to preserve content integrity and prevent unauthorized access.
135
137
- Provide a feedback channel that allows users and individuals to report issues they might experience with the service.
136
-
- Be aware of any applicable laws or regulations that exist in your area regarding processing, analyzing, and sharing media that features people.
138
+
- Be aware of any applicable laws or regulations that exist in your area about processing, analyzing, and sharing media that features people.
137
139
- Keep a human in the loop. Don't use any solution as a replacement for human oversight and decision making.
138
140
- Fully examine and review the potential of any AI model that you're using to understand its capabilities and limitations.
Copy file name to clipboardExpand all lines: articles/azure-video-indexer/face-redaction-with-api.md
+8-8Lines changed: 8 additions & 8 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,17 +1,17 @@
1
1
---
2
-
title: Redact faces by using the Azure AI Video Indexer API
2
+
title: Redact faces by using Azure AI Video Indexer API
3
3
description: Learn how to use the Azure AI Video Indexer face redaction feature by using API.
4
4
ms.topic: how-to
5
5
ms.date: 07/03/2023
6
6
---
7
7
8
-
# Redact faces by using the Azure AI Video Indexer API
8
+
# Redact faces by using Azure AI Video Indexer API
9
9
10
-
You can use Azure AI Video Indexer to detect and identify faces in video. To modify your video to blur (redact) faces of specific individuals, you can use the Face Redaction API.
10
+
You can use Azure AI Video Indexer to detect and identify faces in video. To modify your video to blur (redact) faces of specific individuals, you can use API.
11
11
12
-
A few minutes of footage that contain multiple faces can take hours to redact manually, but by using presets in the Face Redaction API, the face redaction process requires just a few simple steps.
12
+
A few minutes of footage that contain multiple faces can take hours to redact manually, but by using presets in Video Indexer API, the face redaction process requires just a few simple steps.
13
13
14
-
This article shows you how to redact faces by using an API. The Face Redaction API includes a **Face Redaction** preset that offers scalable face detection and redaction (blurring) in the cloud. The article demonstrates each step of how to redact faces by using the API in detail.
14
+
This article shows you how to redact faces by using an API. Video Indexer API includes a **Face Redaction** preset that offers scalable face detection and redaction (blurring) in the cloud. The article demonstrates each step of how to redact faces by using the API in detail.
15
15
16
16
The following video shows how to redact a video by using Azure AI Video Indexer API.
17
17
@@ -27,7 +27,7 @@ Face service access is limited based on eligibility and usage criteria to suppor
27
27
28
28
Face redaction in Video Indexer relies on the output of existing Video Indexer face detection results that we provide in our Video Standard and Advanced Analysis presets.
29
29
30
-
To redact a video, you must first upload a video to Video Indexer and complete an analysis by using the **Standard** or **Advanced** video presets. You can do this by using the [Azure Video Indexer website](https://www.videoindexer.ai/media/library) or [API](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Upload-Video). You can then use the face redaction API to reference this video by using the `videoId` value. We create a new video in which the indicated faces are redacted. Both the video analysis and face redaction are separate billable jobs. For more information, see our [pricing page](https://azure.microsoft.com/pricing/details/video-indexer/).
30
+
To redact a video, you must first upload a video to Video Indexer and complete an analysis by using the **Standard** or **Advanced** video presets. You can do this by using the [Azure Video Indexer website](https://www.videoindexer.ai/media/library) or [API](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Upload-Video). You can then use face redaction API to reference this video by using the `videoId` value. We create a new video in which the indicated faces are redacted. Both the video analysis and face redaction are separate billable jobs. For more information, see our [pricing page](https://azure.microsoft.com/pricing/details/video-indexer/).
31
31
32
32
## Types of blurring
33
33
@@ -65,7 +65,7 @@ Or, use a number that represents the type of blurring that's described in the pr
65
65
66
66
## Filters
67
67
68
-
You can apply filters to set which face IDs to blur. You can specify the IDs of the faces in a comma-separated array in the body of the JSON file. Use the `scope` parameter to exclude or include these faces for redaction. By specifying IDs, you can either redact all faces *except* the IDs you indicate or redact *only* those IDs. See examples in the next sections.
68
+
You can apply filters to set which face IDs to blur. You can specify the IDs of the faces in a comma-separated array in the body of the JSON file. Use the `scope` parameter to exclude or include these faces for redaction. By specifying IDs, you can either redact all faces *except* the IDs that you indicate or redact *only* those IDs. See examples in the next sections.
69
69
70
70
### Exclude scope
71
71
@@ -185,7 +185,7 @@ This URL redirects to the .mp4 file that's stored in the Azure Storage account.
185
185
186
186
| Question | Answer |
187
187
|---|---|
188
-
| Can I upload a video and redact in one operation? | No. You need to first upload and analyze a video by using the Video Indexer API. Then, reference the indexed video in your redaction job. |
188
+
| Can I upload a video and redact in one operation? | No. You need to first upload and analyze a video by using Video Indexer API. Then, reference the indexed video in your redaction job. |
189
189
| Can I use the [Azure AI Video Indexer website](https://www.videoindexer.ai/) to redact a video? | No. Currently you can use only the API to create a redaction job.|
190
190
| Can I play back the redacted video by using the Video Indexer [website](https://www.videoindexer.ai/)?| Yes. The redacted video is visible on the Video Indexer website like any other indexed video, but it doesn't contain any insights. |
191
191
| How do I delete a redacted video? | You can use the [Delete Video](https://api-portal.videoindexer.ai/api-details#api=Operations&operation=Delete-Video) API and provide the `Videoid` value for the redacted video. |
0 commit comments