You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: Azure OpenAI GPT-4 Turbo with Vision tool in Azure AI Studio
3
3
titleSuffix: Azure AI Studio
4
-
description: This article introduces the Azure OpenAI GPT-4 Turbo with Vision tool for flows in Azure AI Studio.
4
+
description: This article introduces you to the Azure OpenAI GPT-4 Turbo with Vision tool for flows in Azure AI Studio.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.topic: how-to
@@ -15,26 +15,26 @@ author: lgayhardt
15
15
16
16
[!INCLUDE [Azure AI Studio preview](../../includes/preview-ai-studio.md)]
17
17
18
-
The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use your Azure OpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.
18
+
The prompt flow Azure OpenAI GPT-4 Turbo with Vision tool enables you to use your Azure OpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them.
19
19
20
20
## Prerequisites
21
21
22
-
- An Azure subscription - <ahref="https://azure.microsoft.com/free/cognitive-services"target="_blank">Create one for free</a>.
22
+
- An Azure subscription. <ahref="https://azure.microsoft.com/free/cognitive-services"target="_blank">You can create one for free</a>.
23
23
- Access granted to Azure OpenAI in the desired Azure subscription.
24
24
25
-
Currently, access to this service is granted only by application. You can apply for access to Azure OpenAI by completing the form at <ahref="https://aka.ms/oai/access"target="_blank">https://aka.ms/oai/access</a>. Open an issue on this repo to contact us if you have an issue.
25
+
Currently, you must apply for access to this service. To apply for access to Azure OpenAI, complete the form at <ahref="https://aka.ms/oai/access"target="_blank">https://aka.ms/oai/access</a>. Open an issue on this repo to contact us if you have an issue.
26
26
27
-
- An [Azure AI hub resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in [one of the regions that support GPT-4 Turbo with Vision](../../../ai-services/openai/concepts/models.md#model-summary-table-and-region-availability). When you deploy from your project's **Deployments** page, select:`gpt-4` as the model name and `vision-preview` as the model version.
27
+
- An [Azure AI hub resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in [one of the regions that support GPT-4 Turbo with Vision](../../../ai-services/openai/concepts/models.md#model-summary-table-and-region-availability). When you deploy from your project's **Deployments** page, select `gpt-4` as the model name and `vision-preview` as the model version.
28
28
29
29
## Build with the Azure OpenAI GPT-4 Turbo with Vision tool
30
30
31
31
1. Create or open a flow in [Azure AI Studio](https://ai.azure.com). For more information, see [Create a flow](../flow-develop.md).
32
32
1. Select **+ More tools** > **Azure OpenAI GPT-4 Turbo with Vision** to add the Azure OpenAI GPT-4 Turbo with Vision tool to your flow.
33
33
34
-
:::image type="content" source="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png" alt-text="Screenshot of the Azure OpenAI GPT-4 Turbo with Vision tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png":::
34
+
:::image type="content" source="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png" alt-text="Screenshot that shows the Azure OpenAI GPT-4 Turbo with Vision tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png":::
35
35
36
36
1. Select the connection to your Azure OpenAI Service. For example, you can select the **Default_AzureOpenAI** connection. For more information, see [Prerequisites](#prerequisites).
37
-
1. Enter values for the Azure OpenAI GPT-4 Turbo with Vision tool input parameters described [here](#inputs). For example, you can use this example prompt:
37
+
1. Enter values for the Azure OpenAI GPT-4 Turbo with Vision tool input parameters described in the [Inputs table](#inputs). For example, you can use this example prompt:
38
38
39
39
```jinja
40
40
# system:
@@ -47,9 +47,10 @@ The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use y
47
47
```
48
48
49
49
1. Select **Validate and parse input** to validate the tool inputs.
50
-
1. Specify an image to analyze in the `image_input` input parameter. For example, you can upload an image or enter the URL of an image to analyze. Otherwise you can paste or drag and drop an image into the tool.
51
-
1. Add more tools to your flow as needed, or select **Run** to run the flow.
52
-
1. The outputs are described [here](#outputs).
50
+
1. Specify an image to analyze in the `image_input` input parameter. For example, you can upload an image or enter the URL of an image to analyze. Otherwise, you can paste or drag and drop an image into the tool.
51
+
1. Add more tools to your flow, as needed. Or select **Run** to run the flow.
52
+
53
+
The outputs are described in the [Outputs table](#outputs).
53
54
54
55
Here's an example output response:
55
56
@@ -67,29 +68,29 @@ Here's an example output response:
67
68
68
69
## Inputs
69
70
70
-
The following are available input parameters:
71
+
The following input parameters are available.
71
72
72
73
| Name | Type | Description | Required |
73
74
| ---- | ---- | ----------- | -------- |
74
75
| connection | AzureOpenAI | The Azure OpenAI connection to be used in the tool. | Yes |
75
76
| deployment\_name | string | The language model to use. | Yes |
76
-
| prompt | string |Text prompt that the language model uses to generate its response. The Jinja template for composing prompts in this tool follows a similar structure to the chat API in the LLM tool. To represent an image input within your prompt, you can use the syntax ``. Image input can be passed in the `user`, `system` and `assistant` messages. | Yes |
77
-
| max\_tokens | integer |Maximum number of tokens to generate in the response. Default is 512. | No |
78
-
| temperature | float |Randomness of the generated text. Default is 1. | No |
79
-
| stop | list |Stopping sequence for the generated text. Default is null. | No |
80
-
| top_p | float |Probability of using the top choice from the generated tokens. Default is 1. | No |
81
-
| presence\_penalty | float |Value that controls the model's behavior regarding repeating phrases. Default is 0. | No |
82
-
| frequency\_penalty | float |Value that controls the model's behavior regarding generating rare phrases. Default is 0. | No |
77
+
| prompt | string |The text prompt that the language model uses to generate its response. The Jinja template for composing prompts in this tool follows a similar structure to the chat API in the large language model (LLM) tool. To represent an image input within your prompt, you can use the syntax ``. Image input can be passed in the `user`, `system`, and `assistant` messages. | Yes |
78
+
| max\_tokens | integer |The maximum number of tokens to generate in the response. Default is 512. | No |
79
+
| temperature | float |The randomness of the generated text. Default is 1. | No |
80
+
| stop | list |The stopping sequence for the generated text. Default is null. | No |
81
+
| top_p | float |The probability of using the top choice from the generated tokens. Default is 1. | No |
82
+
| presence\_penalty | float |The value that controls the model's behavior regarding repeating phrases. Default is 0. | No |
83
+
| frequency\_penalty | float |The value that controls the model's behavior regarding generating rare phrases. Default is 0. | No |
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/prompt-flow-tools/content-safety-tool.md
+17-16Lines changed: 17 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Content Safety tool for flows in Azure AI Studio
3
3
titleSuffix: Azure AI Studio
4
-
description: This article introduces the Content Safety tool for flows in Azure AI Studio.
4
+
description: This article introduces you to the Content Safety tool for flows in Azure AI Studio.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.custom:
@@ -17,41 +17,42 @@ author: lgayhardt
17
17
18
18
[!INCLUDE [Azure AI Studio preview](../../includes/preview-ai-studio.md)]
19
19
20
-
The prompt flow *Content Safety* tool enables you to use Azure AI Content Safety in Azure AI Studio.
20
+
The prompt flow Content Safety tool enables you to use Azure AI Content Safety in Azure AI Studio.
21
21
22
22
Azure AI Content Safety is a content moderation service that helps detect harmful content from different modalities and languages. For more information, see [Azure AI Content Safety](/azure/ai-services/content-safety/).
23
23
24
24
## Prerequisites
25
25
26
-
Create an Azure Content Safety connection:
26
+
To create an Azure Content Safety connection:
27
+
27
28
1. Sign in to [Azure AI Studio](https://studio.azureml.net/).
28
29
1. Go to **AI project settings** > **Connections**.
29
30
1. Select **+ New connection**.
30
-
1. Complete all steps in the **Create a new connection** dialog box. You can use an Azure AI hub resource or Azure AI Content Safety resource. An Azure AI hub resource that supports multiple Azure AI services is recommended.
31
+
1. Complete all steps in the **Create a new connection** dialog. You can use an Azure AI hub resource or Azure AI Content Safety resource. We recommend that you use an Azure AI hub resource that supports multiple Azure AI services.
31
32
32
33
## Build with the Content Safety tool
33
34
34
35
1. Create or open a flow in [Azure AI Studio](https://ai.azure.com). For more information, see [Create a flow](../flow-develop.md).
35
36
1. Select **+ More tools** > **Content Safety (Text)** to add the Content Safety tool to your flow.
36
37
37
-
:::image type="content" source="../../media/prompt-flow/content-safety-tool.png" alt-text="Screenshot of the Content Safety tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/content-safety-tool.png":::
38
+
:::image type="content" source="../../media/prompt-flow/content-safety-tool.png" alt-text="Screenshot that shows the Content Safety tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/content-safety-tool.png":::
38
39
39
40
1. Select the connection to one of your provisioned resources. For example, select **AzureAIContentSafetyConnection** if you created a connection with that name. For more information, see [Prerequisites](#prerequisites).
40
-
1. Enter values for the Content Safety tool input parameters described [here](#inputs).
41
-
1. Add more tools to your flow as needed, or select **Run** to run the flow.
42
-
1. The outputs are described [here](#outputs).
41
+
1. Enter values for the Content Safety tool input parameters described in the [Inputs table](#inputs).
42
+
1. Add more tools to your flow, as needed. Or select **Run** to run the flow.
43
+
1. The outputs are described in the [Outputs table](#outputs).
43
44
44
45
## Inputs
45
46
46
-
The following are available input parameters:
47
+
The following input parameters are available.
47
48
48
49
| Name | Type | Description | Required |
49
50
| ---- | ---- | ----------- | -------- |
50
51
| text | string | The text that needs to be moderated. | Yes |
51
-
| hate_category | string | The moderation sensitivity for Hate category. You can choose from four options: *disable*, *low_sensitivity*, *medium_sensitivity*, or *high_sensitivity*. The *disable* option means no moderation for hate category. The other three options mean different degrees of strictness in filtering out hate content. The default option is *medium_sensitivity*. | Yes |
52
-
| sexual_category | string | The moderation sensitivity for Sexual category. You can choose from four options: *disable*, *low_sensitivity*, *medium_sensitivity*, or *high_sensitivity*. The *disable* option means no moderation for sexual category. The other three options mean different degrees of strictness in filtering out sexual content. The default option is *medium_sensitivity*. | Yes |
53
-
| self_harm_category | string | The moderation sensitivity for Self-harm category. You can choose from four options: *disable*, *low_sensitivity*, *medium_sensitivity*, or *high_sensitivity*. The *disable* option means no moderation for self-harm category. The other three options mean different degrees of strictness in filtering out self_harm content. The default option is *medium_sensitivity*. | Yes |
54
-
| violence_category | string | The moderation sensitivity for Violence category. You can choose from four options: *disable*, *low_sensitivity*, *medium_sensitivity*, or *high_sensitivity*. The *disable* option means no moderation for violence category. The other three options mean different degrees of strictness in filtering out violence content. The default option is *medium_sensitivity*. | Yes |
52
+
| hate_category | string | The moderation sensitivity for the Hate category. You can choose from four options: `disable`, `low_sensitivity`, `medium_sensitivity`, or `high_sensitivity`. The `disable` option means no moderation for the Hate category. The other three options mean different degrees of strictness in filtering out hate content. The default option is `medium_sensitivity`. | Yes |
53
+
| sexual_category | string | The moderation sensitivity for the Sexual category. You can choose from four options: `disable`, `low_sensitivity`, `medium_sensitivity`, or `high_sensitivity`. The `disable` option means no moderation for the Sexual category. The other three options mean different degrees of strictness in filtering out sexual content. The default option is `medium_sensitivity`. | Yes |
54
+
| self_harm_category | string | The moderation sensitivity for the Self-harm category. You can choose from four options: `disable`, `low_sensitivity`, `medium_sensitivity`, or `high_sensitivity`. The `disable` option means no moderation for the Self-harm category. The other three options mean different degrees of strictness in filtering out self-harm content. The default option is `medium_sensitivity`. | Yes |
55
+
| violence_category | string | The moderation sensitivity for the Violence category. You can choose from four options: `disable`, `low_sensitivity`, `medium_sensitivity`, or `high_sensitivity`. The `disable` option means no moderation for the Violence category. The other three options mean different degrees of strictness in filtering out violence content. The default option is `medium_sensitivity`. | Yes |
55
56
56
57
## Outputs
57
58
@@ -69,12 +70,12 @@ The following JSON format response is an example returned by the tool:
69
70
}
70
71
```
71
72
72
-
You can use the following parameters as inputs for this tool:
73
+
You can use the following parameters as inputs for this tool.
73
74
74
75
| Name | Type | Description |
75
76
| ---- | ---- | ----------- |
76
-
| action_by_category | string | A binary value for each category: *Accept* or *Reject*. This value shows if the text meets the sensitivity level that you set in the request parameters for that category. |
77
-
| suggested_action | string | An overall recommendation based on the four categories. If any category has a *Reject* value, the `suggested_action` is *Reject* as well. |
77
+
| action_by_category | string | A binary value for each category: `Accept` or `Reject`. This value shows if the text meets the sensitivity level that you set in the request parameters for that category. |
78
+
| suggested_action | string | An overall recommendation based on the four categories. If any category has a `Reject` value, `suggested_action` is also `Reject`. |
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/prompt-flow-tools/embedding-tool.md
+11-13Lines changed: 11 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Embedding tool for flows in Azure AI Studio
3
3
titleSuffix: Azure AI Studio
4
-
description: This article introduces the Embedding tool for flows in Azure AI Studio.
4
+
description: This article introduces you to the Embedding tool for flows in Azure AI Studio.
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.custom:
@@ -17,32 +17,31 @@ author: lgayhardt
17
17
18
18
[!INCLUDE [Azure AI Studio preview](../../includes/preview-ai-studio.md)]
19
19
20
-
The prompt flow *Embedding* tool enables you to convert text into dense vector representations for various natural language processing tasks
20
+
The prompt flow Embedding tool enables you to convert text into dense vector representations for various natural language processing tasks.
21
21
22
22
> [!NOTE]
23
-
> For chat and completion tools, check out the [LLM tool](llm-tool.md).
23
+
> For chat and completion tools, learn more about the large language model [(LLM) tool](llm-tool.md).
24
24
25
25
## Build with the Embedding tool
26
26
27
27
1. Create or open a flow in [Azure AI Studio](https://ai.azure.com). For more information, see [Create a flow](../flow-develop.md).
28
28
1. Select **+ More tools** > **Embedding** to add the Embedding tool to your flow.
29
29
30
-
:::image type="content" source="../../media/prompt-flow/embedding-tool.png" alt-text="Screenshot of the Embedding tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/embedding-tool.png":::
30
+
:::image type="content" source="../../media/prompt-flow/embedding-tool.png" alt-text="Screenshot that shows the Embedding tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/embedding-tool.png":::
31
31
32
32
1. Select the connection to one of your provisioned resources. For example, select **Default_AzureOpenAI**.
33
-
1. Enter values for the Embedding tool input parameters described [here](#inputs).
34
-
1. Add more tools to your flow as needed, or select **Run** to run the flow.
35
-
1. The outputs are described [here](#outputs).
36
-
33
+
1. Enter values for the Embedding tool input parameters described in the [Inputs table](#inputs).
34
+
1. Add more tools to your flow, as needed. Or select **Run** to run the flow.
35
+
1. The outputs are described in the [Outputs table](#outputs).
0 commit comments