You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cognitive-services/Computer-vision/use-case-alt-text.md
+37-21Lines changed: 37 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,45 +9,61 @@ manager: nitinme
9
9
ms.service: cognitive-services
10
10
ms.subservice: computer-vision
11
11
ms.topic: conceptual
12
-
ms.date: 07/22/2022
12
+
ms.date: 03/17/2023
13
13
ms.author: pafarley
14
14
---
15
15
16
16
17
-
# Overview: Generate alt text of images with Image Analysis
17
+
# Overview: Generate image alt-text with Image Analysis
18
18
19
-
Grow your customer base by making your products and services more accessible. Generate a description of an image in human-readable language, using complete sentences. Computer Vision's algorithms generate various descriptions based on the objects identified in the image. The descriptions are each evaluated, and a confidence score is generated. You then get the list of descriptions, ordered from highest confidence score to lowest.
19
+
## What is alt text?
20
20
21
-
## Image captioning example
21
+
Alt text, or alternative text, is an HTML attribute added to the `<img>` tag that displays images on an application or web page. It looks like this in plain HTML code:
22
22
23
-
The following screenshot is an example of automatically generated alt text for an image.
23
+
`<img src="elephant.jpg" alt="An elephant in a grassland">`
24
24
25
-
:::image type="content" source="media/use-cases/studio-alt-text.png" alt-text="Screenshot of Vision Studio with a caption generated for an image of cows.":::
25
+
Alt text enables website owners to describe an image in plain text. These image descriptions improve accessibility by enabling screen readers such as Microsoft Narrator, JAWS, and NVDA to accurately communicate image content to their visually impaired and blind users.
26
26
27
-
## Adding alt text to images
27
+
Alt text is also vital for image search engine optimization (SEO). It helps search engines understand the visual content in your images. The search engine is then better able to include and rank your website in search results when users search for the content in your website.
28
28
29
-
Alternative text (alt text) is descriptive text that conveys the meaning and context of a visual item in a digital setting, such as on an app or web page. When screen readers such as Microsoft Narrator, JAWS, and NVDA reach digital content with alt text, they read the alt text aloud, allowing people to better understand what is on the screen. Well written, descriptive alt text dramatically reduces ambiguity and improves the user experience. Alt text needs to convey the purpose and meaning of an image, which requires understanding and interpretation in addition to object detection.
29
+
## Auto-generate alt textwith Image Analysis
30
30
31
-
## Key features
31
+
Image Analysis offers image captioning models that generate one-sentence descriptions of image visual content. You can use these AI generated captions as alt text for your images.
32
32
33
-
- Human-readable captions with confidence: Generate a description of an entire image in human-readable language, using complete sentences. Computer Vision's algorithms generate various descriptions based on the objects identified in the image. The descriptions are each evaluated and a confidence score generated. A list is then returned ordered from highest confidence score to lowest.
34
-
- Multiple captions available: You can specify the number of possible captions it will generate and choose the one that works best for your business.
33
+
:::image type="content" source="media/use-cases/elephant.png" alt-text="An elephant in a grassland.":::
35
34
36
-
## Benefits for your business
35
+
Auto-generated caption: "An elephant in a grassland."
37
36
38
-
Accessibility is the design of products, devices, services, vehicles, or environments to be usable by people with disabilities. Accessibility has been an increasingly important topic in product and service development as it makes digital experiences available to more people in the world. Accessibility will boost your business in multiple ways:
37
+
Microsoft’s own products such as PowerPoint, Word, and Edge browser use image captioning by Image Analysis to generate alt text.
39
38
40
-
-**Improve user experience**: by adding alt text, you make the information in images available to users who are blind or have low vision, as well as users who can't load the images due to internet connection.
41
-
-**Make images more discoverable and searchable**: adding captions and tags to images will help search engine crawlers find your images and rank them higher in search results.
42
-
-**Meet legal compliance**: there may potentially be legal repercussions for business that aren't accessibility-compliant. Building products with higher accessibility helps the business avoid potential risks of legal action now and in the future.
39
+
:::image type="content" source="media/use-cases/powerpoint-alt-text.png" alt-text="Screenshot of a PowerPoint slide with alt text written on the side." lightbox="media/use-cases/powerpoint-alt-text.png" :::
43
40
44
-
41
+
## Benefits for your website
45
42
46
-
## Next Steps
47
-
The following tutorial provides a complete solution to generate alternative text of images on web applications.
43
+
-**Improve accessibility and user experience for blind and low-vision users**. Alt Text makes visual information in images available to screen readers used by blind and low-vision users.
44
+
-**Meet legal compliance requirements**. Some websites may be legally required to remove all accessibility barriers. Using alt text for accessibility helps website owners minimize risk of legal action now and in the future.
45
+
-**Make your website more discoverable and searchable**. Image alt text helps search engine crawlers find images on your website more easily and rank them higher in search results.
48
46
49
-
> [!div class="nextstepaction"]
50
-
> [Tutorial: Use Computer Vision to generate image metadata](./Tutorials/storage-lab-tutorial.md)
47
+
## Frequently Asked Questions
48
+
49
+
### What languages are image captions available in?
50
+
51
+
Image captions are available in English, Chinese, Portuguese, Japanese, and Spanish in Image Analysis 3.2 API. In the Image Analysis 4.0 API (preview), image captions are only available in English.
52
+
53
+
### What confidence threshold should I use?
54
+
55
+
To ensure accurate alt text for all images, you can choose to only accept captions above a certain confidence level. The right confidence level varies for each user depending on the type of images and usage scenario.
51
56
57
+
In general, we advise a confidence threshold of `0.4` for the Image Analysis 3.2 API and of `0.0` for the Image Analysis 4.0 API (preview).
52
58
59
+
### What can I do about embarrassing or erroneous captions?
53
60
61
+
On rare occasions, image captions can contain embarrassing errors, such as labeling a male-identifying person as a "woman" or labeling an adult woman as a "girl". We encourage users to consider using the latest Image Analysis 4.0 API (preview) which eliminates some errors by supporting gender-neutral captions.
62
+
63
+
Please report any embarrassing or offensive captions by going to the [Azure portal](https://ms.portal.azure.com/#home) and navigating to the **Feedback** button in the top right.
64
+
65
+
## Next Steps
66
+
Follow a quickstart to begin automatically generating alt text by using image captioning on Image Analysis.
0 commit comments