Skip to content

Commit 58086f6

Browse files
Merge pull request #231241 from PatrickFarley/comvis-updates
[cog svcs] use-case revision from dybe
2 parents fa9ceb9 + be2dd24 commit 58086f6

File tree

3 files changed

+37
-21
lines changed

3 files changed

+37
-21
lines changed
266 KB
Loading
141 KB
Loading

articles/cognitive-services/Computer-vision/use-case-alt-text.md

Lines changed: 37 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -9,45 +9,61 @@ manager: nitinme
99
ms.service: cognitive-services
1010
ms.subservice: computer-vision
1111
ms.topic: conceptual
12-
ms.date: 07/22/2022
12+
ms.date: 03/17/2023
1313
ms.author: pafarley
1414
---
1515

1616

17-
# Overview: Generate alt text of images with Image Analysis
17+
# Overview: Generate image alt-text with Image Analysis
1818

19-
Grow your customer base by making your products and services more accessible. Generate a description of an image in human-readable language, using complete sentences. Computer Vision's algorithms generate various descriptions based on the objects identified in the image. The descriptions are each evaluated, and a confidence score is generated. You then get the list of descriptions, ordered from highest confidence score to lowest.
19+
## What is alt text?
2020

21-
## Image captioning example
21+
Alt text, or alternative text, is an HTML attribute added to the `<img>` tag that displays images on an application or web page. It looks like this in plain HTML code:
2222

23-
The following screenshot is an example of automatically generated alt text for an image.
23+
`<img src="elephant.jpg" alt="An elephant in a grassland">`
2424

25-
:::image type="content" source="media/use-cases/studio-alt-text.png" alt-text="Screenshot of Vision Studio with a caption generated for an image of cows.":::
25+
Alt text enables website owners to describe an image in plain text. These image descriptions improve accessibility by enabling screen readers such as Microsoft Narrator, JAWS, and NVDA to accurately communicate image content to their visually impaired and blind users.
2626

27-
## Adding alt text to images
27+
Alt text is also vital for image search engine optimization (SEO). It helps search engines understand the visual content in your images. The search engine is then better able to include and rank your website in search results when users search for the content in your website.
2828

29-
Alternative text (alt text) is descriptive text that conveys the meaning and context of a visual item in a digital setting, such as on an app or web page. When screen readers such as Microsoft Narrator, JAWS, and NVDA reach digital content with alt text, they read the alt text aloud, allowing people to better understand what is on the screen. Well written, descriptive alt text dramatically reduces ambiguity and improves the user experience. Alt text needs to convey the purpose and meaning of an image, which requires understanding and interpretation in addition to object detection.
29+
## Auto-generate alt text with Image Analysis
3030

31-
## Key features
31+
Image Analysis offers image captioning models that generate one-sentence descriptions of image visual content. You can use these AI generated captions as alt text for your images.
3232

33-
- Human-readable captions with confidence: Generate a description of an entire image in human-readable language, using complete sentences. Computer Vision's algorithms generate various descriptions based on the objects identified in the image. The descriptions are each evaluated and a confidence score generated. A list is then returned ordered from highest confidence score to lowest.
34-
- Multiple captions available: You can specify the number of possible captions it will generate and choose the one that works best for your business.
33+
:::image type="content" source="media/use-cases/elephant.png" alt-text="An elephant in a grassland.":::
3534

36-
## Benefits for your business
35+
Auto-generated caption: "An elephant in a grassland."
3736

38-
Accessibility is the design of products, devices, services, vehicles, or environments to be usable by people with disabilities. Accessibility has been an increasingly important topic in product and service development as it makes digital experiences available to more people in the world. Accessibility will boost your business in multiple ways:
37+
Microsoft’s own products such as PowerPoint, Word, and Edge browser use image captioning by Image Analysis to generate alt text.
3938

40-
- **Improve user experience**: by adding alt text, you make the information in images available to users who are blind or have low vision, as well as users who can't load the images due to internet connection.
41-
- **Make images more discoverable and searchable**: adding captions and tags to images will help search engine crawlers find your images and rank them higher in search results.
42-
- **Meet legal compliance**: there may potentially be legal repercussions for business that aren't accessibility-compliant. Building products with higher accessibility helps the business avoid potential risks of legal action now and in the future.
39+
:::image type="content" source="media/use-cases/powerpoint-alt-text.png" alt-text="Screenshot of a PowerPoint slide with alt text written on the side." lightbox="media/use-cases/powerpoint-alt-text.png" :::
4340

44-
41+
## Benefits for your website
4542

46-
## Next Steps
47-
The following tutorial provides a complete solution to generate alternative text of images on web applications.
43+
- **Improve accessibility and user experience for blind and low-vision users**. Alt Text makes visual information in images available to screen readers used by blind and low-vision users.
44+
- **Meet legal compliance requirements**. Some websites may be legally required to remove all accessibility barriers. Using alt text for accessibility helps website owners minimize risk of legal action now and in the future.
45+
- **Make your website more discoverable and searchable**. Image alt text helps search engine crawlers find images on your website more easily and rank them higher in search results.
4846

49-
> [!div class="nextstepaction"]
50-
> [Tutorial: Use Computer Vision to generate image metadata](./Tutorials/storage-lab-tutorial.md)
47+
## Frequently Asked Questions
48+
49+
### What languages are image captions available in?
50+
51+
Image captions are available in English, Chinese, Portuguese, Japanese, and Spanish in Image Analysis 3.2 API. In the Image Analysis 4.0 API (preview), image captions are only available in English.
52+
53+
### What confidence threshold should I use?
54+
55+
To ensure accurate alt text for all images, you can choose to only accept captions above a certain confidence level. The right confidence level varies for each user depending on the type of images and usage scenario.
5156

57+
In general, we advise a confidence threshold of `0.4` for the Image Analysis 3.2 API and of `0.0` for the Image Analysis 4.0 API (preview).
5258

59+
### What can I do about embarrassing or erroneous captions?
5360

61+
On rare occasions, image captions can contain embarrassing errors, such as labeling a male-identifying person as a "woman" or labeling an adult woman as a "girl". We encourage users to consider using the latest Image Analysis 4.0 API (preview) which eliminates some errors by supporting gender-neutral captions.
62+
63+
Please report any embarrassing or offensive captions by going to the [Azure portal](https://ms.portal.azure.com/#home) and navigating to the **Feedback** button in the top right.
64+
65+
## Next Steps
66+
Follow a quickstart to begin automatically generating alt text by using image captioning on Image Analysis.
67+
68+
> [!div class="nextstepaction"]
69+
> [Image Analysis quickstart](./quickstarts-sdk/image-analysis-client-library-40.md)

0 commit comments

Comments
 (0)