Skip to content

Commit d4c0f35

Browse files
authored
Merge pull request #247203 from mhopkins-msft/mh-avi
Emotions updates
2 parents 973fa59 + c040758 commit d4c0f35

File tree

7 files changed

+300
-279
lines changed

7 files changed

+300
-279
lines changed

articles/azure-video-indexer/concepts-overview.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
title: Azure AI Video Indexer terminology & concepts overview
33
description: This article gives a brief overview of Azure AI Video Indexer terminology and concepts.
44
ms.topic: conceptual
5-
ms.date: 12/01/2022
5+
ms.date: 08/02/2023
66
ms.author: juliako
77
---
88

@@ -12,13 +12,13 @@ This article gives a brief overview of Azure AI Video Indexer terminology and co
1212

1313
## Artifact files
1414

15-
If you plan to download artifact files, beware of the following:
15+
If you plan to download artifact files, beware of the following warning:
1616

1717
[!INCLUDE [artifacts](./includes/artifacts.md)]
1818

1919
## Confidence scores
2020

21-
The confidence score indicates the confidence in an insight. It is a number between 0.0 and 1.0. The higher the score the greater the confidence in the answer. For example:
21+
The confidence score indicates the confidence in an insight. It's a number between 0.0 and 1.0. The higher the score the greater the confidence in the answer. For example:
2222

2323
```json
2424
"transcript":[
@@ -45,7 +45,7 @@ Use textual and visual content moderation models to keep your users safe from in
4545

4646
## Insights
4747

48-
Insights contain an aggregated view of the data: faces, topics, emotions. Azure AI Video Indexer analyzes the video and audio content by running 30+ AI models, generating rich insights.
48+
Insights contain an aggregated view of the data: faces, topics, text-based emotion detection. Azure AI Video Indexer analyzes the video and audio content by running 30+ AI models, generating rich insights.
4949

5050
For detailed explanation of insights, see [Azure AI Video Indexer insights](insights-overview.md).
5151

@@ -55,7 +55,7 @@ Azure AI Video Indexer selects the frame(s) that best represent each shot. Keyfr
5555

5656
## Time range vs. adjusted time range
5757

58-
Time range is the time period in the original video. Adjusted time range is the time range relative to the current playlist. Since you can create a playlist from different lines of different videos, you can take a 1-hour video and use just 1 line from it, for example, 10:00-10:15. In that case, you will have a playlist with 1 line, where the time range is 10:00-10:15 but the adjusted time range is 00:00-00:15.
58+
Time range is the time period in the original video. Adjusted time range is the time range relative to the current playlist. Since you can create a playlist from different lines of different videos, you can take a one-hour video and use just one line from it, for example, 10:00-10:15. In that case, you'll have a playlist with one line, where the time range is 10:00-10:15 but the adjusted time range is 00:00-00:15.
5959

6060
## Widgets
6161

articles/azure-video-indexer/detected-clothing.md

Lines changed: 12 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -2,32 +2,32 @@
22
title: Enable detected clothing feature
33
description: Azure AI Video Indexer detects clothing associated with the person wearing it in the video and provides information such as the type of clothing detected and the timestamp of the appearance (start, end). The API returns the detection confidence level.
44
ms.topic: how-to
5-
ms.date: 11/15/2021
5+
ms.date: 08/02/2023
66
ms.author: juliako
77
---
88

99
# Enable detected clothing feature (preview)
1010

11-
Azure AI Video Indexer detects clothing associated with the person wearing it in the video and provides information such as the type of clothing detected and the timestamp of the appearance (start, end). The API returns the detection confidence level.
11+
Azure AI Video Indexer detects clothing associated with the person wearing it in the video and provides information such as the type of clothing detected and the timestamp of the appearance (start, end). The API returns the detection confidence level. The clothing types that are detected are long pants, short pants, long sleeves, short sleeves, and skirt or dress.
1212

1313
Two examples where this feature could be useful:
1414

15-
* Improve efficiency when creating raw data for content creators, like video advertising, news, or sport games (for example, find people wearing a red shirt in a video archive).
16-
* Post-event analysis—detect and track a person’s movement to better analyze an accident or crime post-event (for example, explosion, bank robbery, incident).
15+
- Improve efficiency when creating raw data for content creators, like video advertising, news, or sport games (for example, find people wearing a red shirt in a video archive).
16+
- Post-event analysis—detect and track a person’s movement to better analyze an accident or crime post-event (for example, explosion, bank robbery, incident).
1717

18-
The newly added clothing detection feature is available when indexing your file by choosing the **Advanced option** -> **Advanced video** or **Advanced video + audio** preset (under Video + audio indexing). Standard indexing will not include this new advanced model.
18+
The newly added clothing detection feature is available when indexing your file by choosing the **Advanced option** -> **Advanced video** or **Advanced video + audio** preset (under Video + audio indexing). Standard indexing won't include this new advanced model.
1919

2020
:::image type="content" source="./media/detected-clothing/index-video.png" alt-text="This screenshot represents an indexing video option":::
2121

2222
When you choose to see **Insights** of your video on the [Azure AI Video Indexer](https://www.videoindexer.ai/) website, the People's detected clothing could be viewed from the **Observed People** tracing insight. When choosing a thumbnail of a person the detected clothing became available.
2323

2424
:::image type="content" source="./media/detected-clothing/observed-people.png" alt-text="Observed people screenshot":::
2525

26-
If you are interested to view People's detected clothing in the Timeline of your video on the Azure AI Video Indexer website, go to **View** -> **Show Insights** and select the **All** option or **View** -> **Custom View** and select **Observed People**.
26+
If you're interested to view People's detected clothing in the Timeline of your video on the Azure AI Video Indexer website, go to **View** -> **Show Insights** and select the All option, or **View** -> **Custom View** and select **Observed People**.
2727

2828
:::image type="content" source="./media/detected-clothing/observed-person.png" alt-text="Observed person screenshot":::
2929

30-
Searching for a specific clothing to return all the observed people wearing it is enabled using the search bar of either the **Insights** or from the **Timeline** of your video on the Azure AI Video Indexer website .
30+
Searching for a specific clothing to return all the observed people wearing it's enabled using the search bar of either the **Insights** or from the **Timeline** of your video on the Azure AI Video Indexer website.
3131

3232
The following JSON response illustrates what Azure AI Video Indexer returns when tracing observed people having detected clothing associated:
3333

@@ -94,18 +94,11 @@ The following JSON response illustrates what Azure AI Video Indexer returns when
9494

9595
## Limitations and assumptions
9696

97-
It's important to note the limitations of Detected clothing, to avoid or mitigate the effects of false negatives (missed detections).
98-
99-
* To optimize the detector results, use video footage from static cameras (although a moving camera or mixed scenes will also give results).
100-
* People are not detected if they appear small (minimum person height is 200 pixels).
101-
* Maximum frame size is HD
102-
* People are not detected if they're not standing or walking.
103-
* Low-quality video (for example, dark lighting conditions) may impact the detection results.
104-
* The recommended frame rate at least 30 FPS.
105-
* Recommended video input should contain up to 10 people in a single frame. The feature could work with more people in a single frame, but the detection result retrieves up to 10 people in a frame with the detection highest confidence.
106-
* People with similar clothes (for example, people wear uniforms, players in sport games) could be detected as the same person with the same ID number.
107-
* Obstructions – there maybe errors where there are obstructions (scene/self or obstructions by other people).
108-
* Pose: The tracks may be split due to different poses (back/front)
97+
As the detected clothing feature uses observed people tracking, the tracking quality is important. For tracking considerations and limitations, see [Considerations and limitations when choosing a use case](observed-matched-people.md#considerations-and-limitations-when-choosing-a-use-case).
98+
99+
- As clothing detection is dependent on the visibility of the person’s body, the accuracy is higher if a person is fully visible.
100+
- There maybe errors when a person is without clothing.
101+
- In this scenario or others of poor visibility, results may be given such as long pants and skirt or dress.
109102

110103
## Next steps
111104

0 commit comments

Comments
 (0)