You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/prompt-flow-tools/azure-open-ai-gpt-4v-tool.md
+1-2Lines changed: 1 addition & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,6 @@ ms.date: 2/26/2024
9
9
ms.reviewer: keli19
10
10
ms.author: lagayhar
11
11
author: lgayhardt
12
-
ms.custom: references_regions
13
12
---
14
13
15
14
# Azure OpenAI GPT-4 Turbo with Vision tool in Azure AI Studio
@@ -25,7 +24,7 @@ The prompt flow *Azure OpenAI GPT-4 Turbo with Vision* tool enables you to use y
25
24
26
25
Currently, access to this service is granted only by application. You can apply for access to Azure OpenAI by completing the form at <ahref="https://aka.ms/oai/access"target="_blank">https://aka.ms/oai/access</a>. Open an issue on this repo to contact us if you have an issue.
27
26
28
-
- An [Azure AI hub resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in one of the regions that support GPT-4 Turbo with Vision: Australia East, Switzerland North, Sweden Central, and West US. When you deploy from your project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
27
+
- An [Azure AI hub resource](../../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in [one of the regions that support GPT-4 Turbo with Vision](../../../ai-services/openai/concepts/models.md#model-summary-table-and-region-availability). When you deploy from your project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
29
28
30
29
## Build with the Azure OpenAI GPT-4 Turbo with Vision tool
Copy file name to clipboardExpand all lines: articles/ai-studio/how-to/prompt-flow-tools/prompt-flow-tools-overview.md
+17-18Lines changed: 17 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -5,7 +5,7 @@ description: Learn about prompt flow tools that are available in Azure AI Studio
5
5
manager: scottpolly
6
6
ms.service: azure-ai-studio
7
7
ms.topic: overview
8
-
ms.date: 2/6/2024
8
+
ms.date: 4/5/2024
9
9
ms.reviewer: keli19
10
10
ms.author: lagayhar
11
11
author: lgayhardt
@@ -17,26 +17,25 @@ author: lgayhardt
17
17
18
18
The following table provides an index of tools in prompt flow.
19
19
20
-
| Tool or tool set name | Description| Environment| Package name |
20
+
| Tool name | Description | Package name |
21
21
|------|-----------|-------------|--------------|
22
-
|[Large language models](./llm-tool.md)| Use Azure OpenAI large language models for tasks such as text completion or chat. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
23
-
|[Prompt](./prompt-tool.md)| Craft a prompt by using Jinja as the templating language. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
24
-
|[Python](./python-tool.md)| Run Python code. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
25
-
|[Azure OpenAI GPT-4 Turbo with Vision](./azure-open-ai-gpt-4v-tool.md)| Use AzureOpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
26
-
|[Content Safety (Text)](./content-safety-tool.md)| Use Azure AI Content Safety to detect harmful content. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
27
-
|[Index Lookup*](./index-lookup-tool.md)| Search an Azure Machine Learning Vector Index for relevant results by using one or more text queries. | Default |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
28
-
|[Vector Index Lookup*](./vector-index-lookup-tool.md)| Search text or a vector-based query from a vector index. | Default |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
29
-
|[Faiss Index Lookup*](./faiss-index-lookup-tool.md)| Search a vector-based query from the Faiss index file. | Default |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
30
-
|[Vector DB Lookup*](./vector-db-lookup-tool.md)| Search a vector-based query from an existing vector database. | Default |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
31
-
|[Embedding](./embedding-tool.md)| Use Azure OpenAI embedding models to create an embedding vector that represents the input text. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
32
-
|[Serp API](./serp-api-tool.md)| Use Serp API to obtain search results from a specific search engine. | Default |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
33
-
|[Azure AI Language tools*](https://microsoft.github.io/promptflow/integrations/tools/azure-ai-language-tool.html)| This collection of tools is a wrapper for various Azure AI Language APIs, which can help effectively understand and analyze documents and conversations. The capabilities currently supported include Abstractive Summarization, Extractive Summarization, Conversation Summarization, Entity Recognition, Key Phrase Extraction, Language Detection, PII Entity Recognition, Conversational PII, Sentiment Analysis, Conversational Language Understanding, and Translator. You can learn how to use them by the [Sample flows](https://github.com/microsoft/promptflow/tree/e4542f6ff5d223d9800a3687a7cfd62531a9607c/examples/flows/integrations/azure-ai-language). Support contact: [email protected]| Custom |[promptflow-azure-ai-language](https://pypi.org/project/promptflow-azure-ai-language/)|
22
+
|[LLM](./llm-tool.md)| Use large language models (LLM) with the Azure OpenAI Service for tasks such as text completion or chat. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
23
+
|[Prompt](./prompt-tool.md)| Craft a prompt by using Jinja as the templating language. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
24
+
|[Python](./python-tool.md)| Run Python code. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
25
+
|[Azure OpenAI GPT-4 Turbo with Vision](./azure-open-ai-gpt-4v-tool.md)| Use an Azure OpenAI GPT-4 Turbo with Vision model deployment to analyze images and provide textual responses to questions about them. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
26
+
|[Content Safety (Text)](./content-safety-tool.md)| Use Azure AI Content Safety to detect harmful content. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
27
+
|[Embedding](./embedding-tool.md)| Use Azure OpenAI embedding models to create an embedding vector that represents the input text. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
28
+
|[Serp API](./serp-api-tool.md)| Use Serp API to obtain search results from a specific search engine. |[promptflow-tools](https://pypi.org/project/promptflow-tools/)|
29
+
|[Index Lookup](./index-lookup-tool.md)| Search a vector-based query for relevant results using one or more text queries. |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
30
+
|[Vector Index Lookup](./vector-index-lookup-tool.md)<sup>1</sup> | Search text or a vector-based query from a vector index. |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
31
+
|[Faiss Index Lookup](./faiss-index-lookup-tool.md)<sup>1</sup> | Search a vector-based query from the Faiss index file. |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
32
+
|[Vector DB Lookup](./vector-db-lookup-tool.md)<sup>1</sup> For | Search a vector-based query from an existing vector database. |[promptflow-vectordb](https://pypi.org/project/promptflow-vectordb/)|
34
33
35
-
*The asterisks indicate custom tools that the community created. Custom tools extend prompt flow's capabilities for specific use cases. The prompt flow team doesn't officially maintain or endorse these tools. When you encounter questions or issues for these tools, prioritize by using the support contact if the description provides it.
34
+
<sup>1</sup> The Index Lookup tool replaces the three deprecated legacy index tools: Vector Index Lookup, Vector DB Lookup, and Faiss Index Lookup. If you have a flow that contains one of those tools, follow the [migration steps](./index-lookup-tool.md#how-to-migrate-from-legacy-tools-to-the-index-lookup-tool) to upgrade your flow.
36
35
37
-
To discover more custom tools developed by the open-source community, see [More custom tools](https://microsoft.github.io/promptflow/integrations/tools/index.html).
36
+
## Custom tools
38
37
39
-
## Remarks
38
+
To discover more custom tools developed by the open-source community such as [Azure AI Language tools](https://pypi.org/project/promptflow-azure-ai-language/), see [More custom tools](https://microsoft.github.io/promptflow/integrations/tools/index.html).
40
39
41
40
- If existing tools don't meet your requirements, you can [develop your own custom tool and make a tool package](https://microsoft.github.io/promptflow/how-to-guides/develop-a-tool/create-and-use-tool-package.html).
42
41
- To install the custom tools, if you're using the automatic runtime, you can readily install the publicly released package by adding the custom tool package name in the `requirements.txt` file in the flow folder. Then select **Save and install** to start installation. After completion, the custom tools appear in the tool list. If you want to use a local or private feed package, build an image first, and then set up the runtime based on your image. To learn more, see [How to create and manage a runtime](../create-manage-runtime.md).
@@ -46,4 +45,4 @@ To discover more custom tools developed by the open-source community, see [More
46
45
## Next steps
47
46
48
47
-[Create a flow](../flow-develop.md)
49
-
-[Build your own copilot by using prompt flow](../../tutorials/deploy-copilot-ai-studio.md)
48
+
-[Build your own copilot using prompt flow](../../tutorials/deploy-copilot-ai-studio.md)
Copy file name to clipboardExpand all lines: articles/ai-studio/quickstarts/multimodal-vision.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -34,7 +34,7 @@ Extra usage fees might apply for using GPT-4 Turbo with Vision and Azure AI Visi
34
34
35
35
Currently, access to this service is granted only by application. You can apply for access to Azure OpenAI by completing the form at <ahref="https://aka.ms/oai/access"target="_blank">https://aka.ms/oai/access</a>. Open an issue on this repo to contact us if you have an issue.
36
36
37
-
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in one of the [regions that support GPT-4 Turbo with Vision](../../ai-services/openai/concepts/models.md#gpt-4-and-gpt-4-turbo-preview-model-availability): Australia East, Switzerland North, Sweden Central, and West US. When you deploy from your Azure AI project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
37
+
- An [Azure AI hub resource](../how-to/create-azure-ai-resource.md) with a GPT-4 Turbo with Vision model deployed in one of the [regions that support GPT-4 Turbo with Vision](../../ai-services/openai/concepts/models.md#gpt-4-and-gpt-4-turbo-preview-model-availability). When you deploy from your Azure AI project's **Deployments** page, select: `gpt-4` as the model name and `vision-preview` as the model version.
38
38
- An [Azure AI project](../how-to/create-projects.md) in Azure AI Studio.
39
39
40
40
## Start a chat session to analyze images or video
0 commit comments