Skip to content

Commit 8f7bcc6

Browse files
authored
Merge pull request #50237 from GraemeMalcolm/main
Refresh AI Vision Analyze Images module
2 parents a5fc7d4 + f856c71 commit 8f7bcc6

22 files changed

+279
-288
lines changed

learn-pr/wwl-data-ai/.openpublishing.redirection.wwl-data-ai.json

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5040,6 +5040,10 @@
50405040
{
50415041
"source_path_from_root": "/learn-pr/wwl-data-ai/orchestrate-semantic-kernel-multi-agent-solution/7-summary.yml",
50425042
"redirect_url": "/training/modules/orchestrate-semantic-kernel-multi-agent-solution/8-summary"
5043+
},
5044+
{
5045+
"source_path_from_root": "/learn-pr/wwl-data-ai/analyze-images/4-generate-smart-cropped-thumbnail.yml",
5046+
"redirect_url": "/azure/ai-services/computer-vision/overview-image-analysis"
50435047
}
50445048
]
50455049
}
Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,18 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.introduction
3-
title: Introduction
4-
metadata:
5-
title: Introduction
6-
description: Introduction
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 02/05/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
azureSandbox: false
14-
labModal: false
15-
durationInMinutes: 3
16-
content: |
17-
[!include[](includes/1-introduction.md)]
18-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.introduction
3+
title: Introduction
4+
metadata:
5+
title: Introduction
6+
description: Introduction
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
azureSandbox: false
14+
labModal: false
15+
durationInMinutes: 3
16+
content: |
17+
[!include[](includes/1-introduction.md)]
18+
Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,18 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.provision-computer-vision-resource
3-
title: Provision an Azure AI Vision resource
4-
metadata:
5-
title: Provision an Azure AI Vision resource
6-
description: Provision an Azure AI Vision resource
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 02/05/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
azureSandbox: false
14-
labModal: false
15-
durationInMinutes: 3
16-
content: |
17-
[!include[](includes/2-provision-computer-vision-resource.md)]
18-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.provision-computer-vision-resource
3+
title: Provision an Azure AI Vision resource
4+
metadata:
5+
title: Provision an Azure AI Vision resource
6+
description: Provision an Azure AI Vision resource
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
azureSandbox: false
14+
labModal: false
15+
durationInMinutes: 3
16+
content: |
17+
[!include[](includes/2-provision-computer-vision-resource.md)]
18+
Lines changed: 20 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -1,20 +1,20 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.analyze-image
3-
title: Analyze an image
4-
metadata:
5-
title: Analyze an image
6-
description: Analyze an image
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 02/05/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
ms.custom: devx-track-python
14-
zone_pivot_groups: dev-lang-csharp-python
15-
azureSandbox: false
16-
labModal: false
17-
durationInMinutes: 3
18-
content: |
19-
[!include[](includes/3-analyze-image.md)]
20-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.analyze-image
3+
title: Analyze an image
4+
metadata:
5+
title: Analyze an image
6+
description: Analyze an image
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
ms.custom: devx-track-python
14+
zone_pivot_groups: dev-lang-csharp-python
15+
azureSandbox: false
16+
labModal: false
17+
durationInMinutes: 3
18+
content: |
19+
[!include[](includes/3-analyze-image.md)]
20+

learn-pr/wwl-data-ai/analyze-images/4-generate-smart-cropped-thumbnail.yml

Lines changed: 0 additions & 18 deletions
This file was deleted.
Lines changed: 16 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -1,19 +1,16 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.exercise-computer-vision
3-
title: Exercise - Analyze images with Azure AI Vision
4-
metadata:
5-
title: Exercise - Analyze images with Azure AI Vision
6-
description: Exercise - Analyze images with Azure AI Vision
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 02/05/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
azureSandbox: false
14-
labId: 152411
15-
labModal: true
16-
durationInMinutes: 30
17-
content: |
18-
[!include[](includes/5-exercise-computer-vision.md)]
19-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.exercise-computer-vision
3+
title: Exercise - Analyze images with Azure AI Vision
4+
metadata:
5+
title: Exercise - Analyze images with Azure AI Vision
6+
description: Exercise - Analyze images with Azure AI Vision
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
durationInMinutes: 30
14+
content: |
15+
[!include[](includes/5-exercise-computer-vision.md)]
16+
Lines changed: 41 additions & 41 deletions
Original file line numberDiff line numberDiff line change
@@ -1,41 +1,41 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.knowledge-check
3-
title: Module assessment
4-
metadata:
5-
title: Module assessment
6-
description: Knowledge check
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 08/29/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
azureSandbox: false
14-
labModal: false
15-
durationInMinutes: 2
16-
quiz:
17-
title: "Check your knowledge"
18-
questions:
19-
- content: "You want to use the Azure AI Vision Analyze Image function to generate an appropriate caption for an image. Which visual feature should you specify?"
20-
choices:
21-
- content: "Tags"
22-
isCorrect: false
23-
explanation: "That's incorrect. To generate a caption, include the DenseCaptions visual feature in your analysis."
24-
- content: "DenseCaptions"
25-
isCorrect: true
26-
explanation: "That's correct. To generate a caption, include the DenseCaptions visual feature in your analysis."
27-
- content: "Objects"
28-
isCorrect: false
29-
explanation: "That's incorrect. To generate a caption, include the DenseCaptions visual feature in your analysis."
30-
- content: "What is the purpose of the Azure AI Vision service?"
31-
choices:
32-
- content: "To provide functionality for audio transcription"
33-
isCorrect: false
34-
explanation: "Incorrect. The Azure AI Vision service is designed to extract information from images, not audio."
35-
- content: "To extract information from images"
36-
isCorrect: true
37-
explanation: "The Azure AI Vision service is designed to help you extract information from images through various functionalities."
38-
- content: "To detect the presence and location of specific sounds within an audio file"
39-
isCorrect: false
40-
explanation: "Incorrect. The Azure AI Vision service is designed to extract information from images, not audio."
41-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.knowledge-check
3+
title: Module assessment
4+
metadata:
5+
title: Module assessment
6+
description: Knowledge check
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
azureSandbox: false
14+
labModal: false
15+
durationInMinutes: 2
16+
quiz:
17+
title: "Check your knowledge"
18+
questions:
19+
- content: "What is the purpose of the Azure AI Vision service?"
20+
choices:
21+
- content: "To provide functionality for audio transcription"
22+
isCorrect: false
23+
explanation: "Incorrect. The Azure AI Vision service is designed to extract information from images, not audio."
24+
- content: "To extract information from images"
25+
isCorrect: true
26+
explanation: "The Azure AI Vision service is designed to help you extract information from images through various functionalities."
27+
- content: "To detect the presence and location of specific sounds within an audio file"
28+
isCorrect: false
29+
explanation: "Incorrect. The Azure AI Vision service is designed to extract information from images, not audio."
30+
- content: "You want to use the Azure AI Vision Analyze Image function to generate an appropriate caption for an image. Which visual feature should you specify?"
31+
choices:
32+
- content: "Tags"
33+
isCorrect: false
34+
explanation: "Incorrect. To generate a caption, include the DenseCaptions visual feature in your analysis."
35+
- content: "DenseCaptions"
36+
isCorrect: true
37+
explanation: "Correct. To generate a caption, include the DenseCaptions visual feature in your analysis."
38+
- content: "Objects"
39+
isCorrect: false
40+
explanation: "Incorrect. To generate a caption, include the DenseCaptions visual feature in your analysis."
41+
Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,18 @@
1-
### YamlMime:ModuleUnit
2-
uid: learn.wwl.analyze-images.summary
3-
title: Summary
4-
metadata:
5-
title: Summary
6-
description: Summary
7-
author: wwlpublish
8-
ms.author: berryivor
9-
ms.date: 02/05/2024
10-
ms.topic: unit
11-
ms.collection:
12-
- wwl-ai-copilot
13-
azureSandbox: false
14-
labModal: false
15-
durationInMinutes: 3
16-
content: |
17-
[!include[](includes/7-summary.md)]
18-
1+
### YamlMime:ModuleUnit
2+
uid: learn.wwl.analyze-images.summary
3+
title: Summary
4+
metadata:
5+
title: Summary
6+
description: Summary
7+
author: wwlpublish
8+
ms.author: berryivor
9+
ms.date: 04/30/2025
10+
ms.topic: unit
11+
ms.collection:
12+
- wwl-ai-copilot
13+
azureSandbox: false
14+
labModal: false
15+
durationInMinutes: 3
16+
content: |
17+
[!include[](includes/7-summary.md)]
18+

learn-pr/wwl-data-ai/analyze-images/includes/1-introduction.md

Lines changed: 15 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,18 @@
1-
Azure AI Vision is a branch of artificial intelligence (AI) in which software interprets visual input, often from images or video feeds.
1+
Computer Vision is a branch of artificial intelligence (AI) in which software interprets visual input, often from images or video feeds. In Microsoft Azure, you can use the **Azure AI Vision** service to implement multiple computer vision scenarios, including:
22

3-
In this module, you'll learn how to use the **Azure AI Vision** service to extract information from images.
3+
- Image analysis
4+
- Optical character recognition (OCR)
5+
- Face detection and analysis
6+
- Video analysis
47

5-
After completing this module, you’ll be able to:
8+
In this module, we'll focus on *image analysis*, and explore how to build applications that use the Azure AI Vision service to analyze and extract and infer insights from images.
9+
10+
![Diagram of the Azure AI Vision service performing image analysis tasks.](../media/computer-vision.png)
11+
12+
As shown in this conceptual diagram, the Azure AI Vision service provides services that you can use to analyze images and:
13+
14+
1. Generate a *caption* for an image based on its contents.
15+
2. Suggest appropriate *tags* to associate with an image.
16+
3. Detect and locate common *objects* in an image.
17+
4. Detect and locate *people* in an image.
618

7-
- Provision an Azure AI Vision resource.
8-
- Analyze an image.
9-
- Remove an image background.
10-
- Generate a smart cropped thumbnail.
Lines changed: 25 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,30 @@
1-
The **Azure AI Vision** service is designed to help you extract information from images. It provides functionality that you can use for:
1+
To use Azure AI Vision image analysis services, you need to provision an Azure AI Vision resource in your Azure subscription. You can choose from multiple provisioning options:
22

3-
- *Description and tag generation* - determining an appropriate caption for an image, and identifying relevant "tags" that can be used as keywords to indicate its subject.
4-
- *Object detection* - detecting the presence and location of specific objects within the image.
5-
- *People detection* - detecting the presence, location, and features of people in the image.
6-
- *Image metadata, color, and type analysis* - determining the format and size of an image, its dominant color palette, and whether it contains clip art.
7-
- *Category identification* - identifying an appropriate categorization for the image, and if it contains any known landmarks.
8-
- *Background removal* - detecting the background in an image and output the image with the background transparent or a greyscale alpha matte image.
9-
- *Moderation rating* - determine if the image includes any adult or violent content.
10-
- *Optical character recognition* - reading text in the image.
11-
- *Smart thumbnail generation* - identifying the main region of interest in the image to create a smaller "thumbnail" version.
3+
![Diagram of AI Foundry containing AI services, which in turn contain AI Vision.](../media/ai-vision-resources.png)
124

13-
![A conceptual image of the Azure AI Vision service](../media/computer-vision.png)
5+
1. Create an **Azure AI Foundry** *project* and an associated *hub*. By default, an Azure AI Foundry hub includes an **Azure AI services** multi-service resource, which includes Azure AI Vision. Azure AI Foundry projects are recommended for development of AI solutions on Azure that combine generative AI, agents, and pre-built Azure AI services, or which involve collaborative development by a team of software engineers and service operators.
6+
1. If you don't need all of the functionality in an Azure AI Foundry hub, you can create an **Azure AI services** multi-service resource in your Azure subscription. You can then use this resource to access Azure AI Vision services and other AI services through a single endpoint and key.
7+
1. If you only need to use Azure AI Vision functionality, or you're just experimenting with the service, you can create a standalone **Computer Vision** resource in your Azure subscription. One benefit of this approach is that the standalone service provides a free tier that you can use to explore the service at no cost.
148

15-
You can provision **Azure AI Vision** as a single-service resource, or you can use the Azure AI Vision API in a multi-service **Azure AI Services** resource.
9+
> [!TIP]
10+
> If you're unfamiliar with Azure AI Foundry and Azure AI services, consider completing the **[Plan and prepare to develop AI solutions on Azure](/training/modules/prepare-azure-ai-development/)** module.
11+
12+
## Connecting to your resource
13+
14+
After you've deployed your resource, you can use the [Azure AI Vision REST API](/rest/api/computervision/image-analysis?azure-portal=true) or a language-specific SDK (such as the [Python SDK](/python/api/overview/azure/ai-vision-imageanalysis-readme?azure-portal=true) or [Microsoft .NET SDK](/dotnet/api/overview/azure/ai.vision.imageanalysis-readme?azure-portal=true)) to connect to it from a client application.
15+
16+
Every Azure AI Vision resource provides an *endpoint* to which client applications must connect. You can find the endpoint for your resource in the Azure portal, or if you're working in an Azure AI Foundry project, in the Azure AI Foundry portal. The endpoint is in the form of a URL, and typically looks something like this:
17+
18+
```
19+
https://<resource_name>.cognitiveservices.azure.com/
20+
```
21+
22+
To connect to the endpoint, client applications must be authenticated. Options for authentication include:
23+
24+
- **Key-based authentication**: Client applications are authenticated by passing an authorization key (which you can find and manage in the portal).
25+
- **Microsoft Entra ID authentication**: Client applications are authenticated by using a Microsoft Entra ID token for credentials that have permission to access the Azure AI Vision resource in Azure.
26+
27+
When developing and testing an application, it's common to use key-based authentication or Microsoft Entra ID authentication based on your own Azure credentials. In production, consider using Microsoft Entra ID authentication based on a managed identity for your Azure application or use Azure Key Vault to store authorization keys securely.
1628

1729
> [!NOTE]
18-
> In this module, we'll focus on the image analysis and thumbnail generation capabilities of the Azure AI Vision service. To learn how to use the Azure AI Vision service for optical character recognition, check out the [Read Text in images and documents with the Azure AI Vision service](/training/modules/read-text-images-documents-with-computer-vision-service/) module.
30+
> When using an Azure AI services resource in an Azure AI Foundry project, you can use the Azure AI Foundry SDK to connect to the project using Microsoft Entra ID authentication, and then retrieve the connection information for your Azure AI services resource, including the authorization key, from the project.

0 commit comments

Comments
 (0)