Skip to content

Commit 203f086

Browse files
committed
some aistudio freshness
1 parent cbcb3d9 commit 203f086

File tree

2 files changed

+31
-27
lines changed

2 files changed

+31
-27
lines changed

articles/ai-studio/concepts/content-filtering.md

Lines changed: 6 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -9,11 +9,10 @@ ms.custom:
99
- build-2024
1010
- ignite-2024
1111
ms.topic: conceptual
12-
ms.date: 5/21/2024
12+
ms.date: 01/10/2025
1313
ms.reviewer: eur
1414
ms.author: pafarley
1515
author: PatrickFarley
16-
---
1716

1817
# Content filtering in Azure AI Foundry portal
1918

@@ -59,15 +58,15 @@ The following special filters work for both input and output of generative AI mo
5958
### Other input filters
6059

6160
You can also enable special filters for generative AI scenarios:
62-
- Jailbreak attacks: Jailbreak Attacks are User Prompts designed to provoke the Generative AI model into exhibiting behaviors it was trained to avoid or to break the rules set in the System Message.
63-
- Indirect attacks: Indirect Attacks, also referred to as Indirect Prompt Attacks or Cross-Domain Prompt Injection Attacks, are a potential vulnerability where third parties place malicious instructions inside of documents that the Generative AI system can access and process.
61+
- **Jailbreak attacks**: Jailbreak Attacks are User Prompts designed to provoke the Generative AI model into exhibiting behaviors it was trained to avoid or to break the rules set in the System Message.
62+
- **Indirect attacks**: Indirect Attacks, also referred to as Indirect Prompt Attacks or Cross-Domain Prompt Injection Attacks, are a potential vulnerability where third parties place malicious instructions inside of documents that the Generative AI system can access and process.
6463

6564
### Other output filters
6665

6766
You can also enable the following special output filters:
68-
- Protected material for text: Protected material text describes known text content (for example, song lyrics, articles, recipes, and selected web content) that can be outputted by large language models.
69-
- Protected material for code: Protected material code describes source code that matches a set of source code from public repositories, which can be outputted by large language models without proper citation of source repositories.
70-
- Groundedness: The groundedness detection filter detects whether the text responses of large language models (LLMs) are grounded in the source materials provided by the users.
67+
- **Protected material for text**: Protected material text describes known text content (for example, song lyrics, articles, recipes, and selected web content) that can be outputted by large language models.
68+
- **Protected material for code**: Protected material code describes source code that matches a set of source code from public repositories, which can be outputted by large language models without proper citation of source repositories.
69+
- **Groundedness**: The groundedness detection filter detects whether the text responses of large language models (LLMs) are grounded in the source materials provided by the users.
7170

7271
[!INCLUDE [create-content-filter](../includes/create-content-filter.md)]
7372

articles/ai-studio/quickstarts/multimodal-vision.md

Lines changed: 25 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -1,31 +1,33 @@
11
---
2-
title: Get started using GPT-4 Turbo with Vision on your images and videos in Azure AI Foundry portal
2+
title: Get started vision-enabled chats in Azure AI Foundry portal
33
titleSuffix: Azure AI Foundry
4-
description: Get started using GPT-4 Turbo with Vision on your images and videos in Azure AI Foundry portal.
4+
description: Get started using vision-enabled chats in Azure AI Foundry portal.
55
manager: nitinme
66
ms.service: azure-ai-studio
77
ms.custom:
88
- build-2024
99
ms.topic: quickstart
10-
ms.date: 5/21/2024
10+
ms.date: 01/10/2025
1111
ms.reviewer: eur
1212
ms.author: pafarley
1313
author: PatrickFarley
1414
---
1515

16-
# Quickstart: Get started using GPT-4 Turbo with Vision on your images and videos in Azure AI Foundry portal
16+
# Quickstart: Get started using vision-enabled chats in Azure AI Foundry portal
1717

1818
[!INCLUDE [feature-preview](../includes/feature-preview.md)]
1919

20-
Use this article to get started using [Azure AI Foundry](https://ai.azure.com) to deploy and test the GPT-4 Turbo with Vision model.
20+
Use this article to get started using [Azure AI Foundry](https://ai.azure.com) to deploy and test a chat completion model with image understanding.
2121

22+
<!--
2223
GPT-4 Turbo with Vision and [Azure AI Vision](../../ai-services/computer-vision/overview.md) offer advanced functionality including:
2324
2425
- Optical Character Recognition (OCR): Extracts text from images and combines it with the user's prompt and image to expand the context.
2526
- Object grounding: Complements the GPT-4 Turbo with Vision text response with object grounding and outlines salient objects in the input images.
2627
- Video prompts: GPT-4 Turbo with Vision can answer questions by retrieving the video frames most relevant to the user's prompt.
28+
-->
2729

28-
Extra usage fees might apply when using GPT-4 Turbo with Vision and Azure AI Vision functionality.
30+
Extra usage fees might apply when using chat completion models with vision functionality.
2931

3032
## Prerequisites
3133

@@ -35,29 +37,29 @@ Extra usage fees might apply when using GPT-4 Turbo with Vision and Azure AI Vis
3537

3638
## Prepare your media
3739

38-
You need an image to complete the image quickstarts. You can use this sample image or any other image you have available.
40+
You need an image to complete this quickstart. You can use this sample image or any other image you have available.
3941

4042
:::image type="content" source="../media/quickstarts/multimodal-vision/car-accident.png" alt-text="Photo of a car accident that can be used to complete the quickstart." lightbox="../media/quickstarts/multimodal-vision/car-accident.png":::
4143

42-
For video prompts, you need a video that's under three minutes in length.
43-
44-
## Deploy a GPT-4 Turbo with Vision model
44+
## Deploy a vision-enabled chat model
4545

4646
1. Sign in to [Azure AI Foundry](https://ai.azure.com) and select the hub you'd like to work in.
47-
1. On the left nav menu, select **AI Services**. Select the **Try out GPT-4 Turbo** panel.
48-
1. On the gpt-4 page, select **Deploy**. In the window that appears, select your Azure OpenAI resource. Select `vision-preview` as the model version.
47+
1. On the left nav menu, select **Models + endpoints** and select **+ Deploy model**.
48+
1. On the model selection page, select a vision-enabled model like GPT-4o. In the window that appears, select a name and deployment type. Make sure your Azure OpenAI resource is connected.
4949
1. Select **Deploy**.
50-
1. Next, go to your new model's page and select **Open in playground**. In the chat playground, the GPT-4 deployment you created should be selected in the **Deployment** dropdown.
50+
1. Next, select your new model and select **Open in playground**. In the chat playground, the deployment you created should be selected in the **Deployment** dropdown.
5151

52-
# [Image prompts](#tab/image-chat)
52+
<!-- # [Image prompts](#tab/image-chat) -->
5353

54-
In this chat session, you instruct the assistant to aid in understanding images that you input.
54+
## Image prompts
5555

56-
1. In the **System message** text box on the **System message** tab, provide this prompt to guide the assistant: `"You're an AI assistant that helps people find information."` You can tailor the prompt to your image or scenario.
56+
In this chat session, you instruct the assistant to aid you in understanding images that you input.
57+
58+
1. In the context text box on the **Setup** panel, provide this prompt to guide the assistant: `"You're an AI assistant that helps people find information."` Or, you can tailor the prompt to your image or scenario.
5759
1. Select **Apply changes** to save your changes.
5860
1. In the chat session pane, select the attachment button and then **Upload image**. Choose your image.
59-
1. Add the following question in the chat field: `"Describe this image"`, and then select the right arrow icon to send.
60-
1. The right arrow icon is replaced by a Stop button. If you select it, the assistant stops processing your request. For this quickstart, let the assistant finish its reply.
61+
1. Add the following prompt in the chat field: `"Describe this image"`, and then select the send icon to submit it.
62+
1. The send icon is replaced by a stop button. If you select it, the assistant stops processing your request. For this quickstart, let the assistant finish its reply.
6163
1. The assistant replies with a description of the image.
6264
<!--:::image type="content" source="../media/quickstarts/multimodal-vision/chat-car-accident-reply-license.png" alt-text="Screenshot of the chat playground with the assistant's reply for basic image analysis." lightbox="../media/quickstarts/multimodal-vision/chat-car-accident-reply-license.png":::-->
6365
1. Ask a follow-up question related to the analysis of your image. You could enter, `"What should I highlight about this image to my insurance company?"`.
@@ -79,7 +81,7 @@ In this chat session, you instruct the assistant to aid in understanding images
7981
8082
Remember to be factual and descriptive, avoiding speculation about the cause of the accident, as the insurance company will conduct its own investigation.
8183
```
82-
84+
<!--
8385
# [Image prompt enhancements](#tab/enhanced-image-chat)
8486
8587
In this chat session, you instruct the assistant to aid in understanding images that you input. Try out the capabilities of the augmented vision model.
@@ -90,7 +92,7 @@ In this chat session, you instruct the assistant to aid in understanding images
9092
1. Add the following question in the chat field: `"Describe this image"`, and then select the right arrow icon to send.
9193
1. The right arrow icon is replaced by a Stop button. If you select it, the assistant stops processing your request. For this quickstart, let the assistant finish its reply.
9294
1. The assistant replies with a description of the image. It uses the Azure AI Vision service to extract more detail from the image you uploaded.
93-
<!--:::image type="content" source="../media/quickstarts/multimodal-vision/chat-image-read-text.png" alt-text="Screenshot of the chat playground with the model output where the text in the image is read and returned." lightbox="../media/quickstarts/multimodal-vision/chat-image-read-text.png":::-->
95+
9496
1. Ask a follow-up question related to the analysis of your image. Enter, `"What should I highlight about this image to my insurance company?" `and then select the right arrow icon to send.
9597
1. You should receive a relevant response similar to what's shown here:
9698
```
@@ -124,6 +126,7 @@ In this chat session, you are instructing the assistant to aid in understanding
124126
1. The assistant should reply with a description of the video.
125127
1. Feel free to ask any follow-up questions related to the analysis of your video.
126128
129+
127130
## Limitations
128131
129132
Below are the known limitations of the video prompt enhancements.
@@ -135,6 +138,8 @@ Below are the known limitations of the video prompt enhancements.
135138
- **Language support:** Currently, the system primarily supports English for grounding with transcripts. Transcripts don't provide accurate information on lyrics from songs.
136139
137140
---
141+
-->
142+
138143
139144
## View and export code
140145

0 commit comments

Comments
 (0)