You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/prompt-flow-tools/azure-open-ai-gpt-4v-tool.md
+27-2Lines changed: 27 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -27,7 +27,6 @@ The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use y
27
27
28
28
- An [Azure AI hub resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in one of the regions that support GPT-4 Turbo with Vision: Australia East, Switzerland North, Sweden Central, and West US. When you deploy from your project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
29
29
30
-
31
30
## Build with the Azure OpenAI GPT-4 Turbo with Vision tool
32
31
33
32
1. Create or open a flow in [Azure AI Studio](https://ai.azure.com). For more information, see [Create a flow](../flow-develop.md).
@@ -36,10 +35,36 @@ The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use y
36
35
:::image type="content" source="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png" alt-text="Screenshot of the Azure OpenAI GPT-4 Turbo with Vision tool added to a flow in Azure AI Studio." lightbox="../../media/prompt-flow/azure-openai-gpt-4-vision-tool.png":::
37
36
38
37
1. Select the connection to to your Azure OpenAI Service. For example, you can select the **Default_AzureOpenAI** connection. For more information, see [Prerequisites](#prerequisites).
39
-
1. Enter values for the Azure OpenAI GPT-4 Turbo with Vision tool input parameters described [here](#inputs).
38
+
1. Enter values for the Azure OpenAI GPT-4 Turbo with Vision tool input parameters described [here](#inputs). For example, you can use this example prompt:
39
+
40
+
```jinja
41
+
# system:
42
+
As an AI assistant, your task involves interpreting images and responding to questions about the image.
43
+
Remember to provide accurate answers based on the information present in the image.
44
+
45
+
# user:
46
+
Can you tell me what the image depicts?
47
+

48
+
```
49
+
50
+
1. Select **Validate and parse input** to validate the tool inputs.
51
+
1. Specify an image to analyze in the `image_input` input parameter. For example, you can upload an image or enter the URL of an image to analyze. Otherwise you can paste or drag and drop an image into the tool.
40
52
1. Add more tools to your flow as needed, or select **Run** to run the flow.
41
53
1. The outputs are described [here](#outputs).
42
54
55
+
Here's an example output response:
56
+
57
+
```json
58
+
{
59
+
"system_metrics": {
60
+
"completion_tokens": 96,
61
+
"duration": 4.874329,
62
+
"prompt_tokens": 1157,
63
+
"total_tokens": 1253
64
+
},
65
+
"output": "The image depicts a user interface for Azure's OpenAI GPT-4 service. It is showing a configuration screen where settings related to the AI's behavior can be adjusted, such as the model (GPT-4), temperature, top_p, frequency penalty, etc. There's also an area where users can enter a prompt to generate text, and an option to include an image input for the AI to interpret, suggesting that this particular interface supports both text and image inputs."
0 commit comments