You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
title: How to create vector index in Azure Machine Learning prompt flow (preview)
2
+
title: Create a vector index in an Azure Machine Learning prompt flow (preview)
3
3
titleSuffix: Azure Machine Learning
4
-
description: How to create a vector index in Azure Machine Learning and use it in a prompt flow.
4
+
description: Learn how to create a vector index in Azure Machine Learning and use it in a prompt flow.
5
5
services: machine-learning
6
6
ms.author: balapv
7
7
author: balapv
@@ -13,77 +13,74 @@ ms.topic: how-to
13
13
ms.custom: prompt-flow
14
14
---
15
15
16
-
# How to create vector index in Azure Machine Learning prompt flow (preview)
16
+
# Create a vector index in an Azure Machine Learning prompt flow (preview)
17
17
18
-
Azure Machine Learning enables you to create a vector index from files/folders on your machine, a location in a cloud storage, an Azure Machine Learning data asset, a Git repository, or an SQL database. Azure Machine Learning can currently crack and process text files, md files, pdf, excel files, word documents. You can also reuse an existing Azure Cognitive Search Index instead of creating a new Index.
18
+
You can use Azure Machine Learning to create a vector index from files or folders on your machine, a location in cloud storage, an Azure Machine Learning data asset, a Git repository, or a SQL database. Azure Machine Learning can currently process .txt, .md, .pdf, .xls, and .docx files. You can also reuse an existing Azure Cognitive Search index instead of creating a new index.
19
19
20
-
When a Vector Index is created, Azure Machine Learning will chunk the data, create embeddings, and store the embeddings in a FAISS Index or Azure Cognitive Search Index. In addition, Azure Machine Learning creates:
20
+
When you create a vector index, Azure Machine Learning chunks the data, creates embeddings, and stores the embeddings in a Faiss index or Azure Cognitive Search index. In addition, Azure Machine Learning creates:
21
21
22
22
* Test data for your data source.
23
23
24
-
* A sample prompt flow, which uses the Vector Index you created. The sample prompt flow, which gets created has several key features like: Automatically generated prompt variants. Evaluation of each of these variations using the [test data generated](https://aka.ms/prompt_flow_blog). Metrics against each of the variants to help you choose the best variant to run. You can use this sample to continue developing your prompt.
24
+
* A sample prompt flow, which uses the vector index that you created. Features of the sample prompt flow include:
25
+
26
+
* Automatically generated prompt variants.
27
+
* Evaluation of each prompt variant by using the [generated test data](https://aka.ms/prompt_flow_blog).
28
+
* Metrics against each prompt variant to help you choose the best variant to run.
29
+
30
+
You can use this sample to continue developing your prompt.
* An Azure subscription. If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/).
31
37
32
-
* Access to Azure Open AI.
33
-
34
-
* Enable prompt flow in your Azure Machine Learning workspace
35
-
36
-
In your Azure Machine Learning workspace, you can enable prompt flow by turn-on **Build AI solutions with Prompt flow** in the **Manage preview features** panel.
37
-
38
-
39
-
## Create a new Vector Index using studio
40
-
41
-
1. Select **Prompt flow** on the left menu
42
-
43
-
:::image type="content" source="media/how-to-create-vector-index/prompt.png" alt-text="Screenshot showing the Prompt flow location on the left menu.":::
44
-
45
-
1. Select **Vector Index** on the top menu
38
+
* Access to Azure OpenAI Service.
46
39
47
-
:::image type="content" source="./media/how-to-create-vector-index/vector-index.png" alt-text="Screenshot showing the Vector Index location on the top menu.":::
40
+
* Prompt flows enabled in your Azure Machine Learning workspace. You can enable prompt flows by turning on **Build AI solutions with Prompt flow** on the **Manage preview features** panel.
48
41
42
+
## Create a vector index by using Machine Learning studio
49
43
50
-
1.Select **Create**
44
+
1. Select **Prompt flow** on the left menu.
51
45
52
-
1. After the create new vectorindex form opens, provide a name for your vector index.
46
+
:::image type="content" source="media/how-to-create-vector-index/prompt.png" alt-text="Screenshot that shows the location of prompt flow on the left menu.":::
53
47
54
-
1. Next choose your data source type
48
+
1.Select the **Vector Index** tab.
55
49
56
-
:::image type="content" source="media/how-to-create-vector-index/new-vector-creation.png" alt-text="Screenshot showing the create new Vector Index form.":::
50
+
:::image type="content" source="./media/how-to-create-vector-index/vector-index.png" alt-text="Screenshot that shows the tab for vector index.":::
57
51
58
-
1. Based on the chosen type, provide the location details of your
59
-
source. Then, select **Next**.
52
+
1. Select **Create**.
60
53
61
-
1. Review the details of your vector index, then select the **Create** button to create the vector index. For more information about how to [use Vector Stores (preview).](concept-vector-stores.md)
54
+
1.When the form for creating a vector index opens, provide a name for your vector index.
62
55
63
-
1. This takes you to an overview page from where you can track and view the status of your Vector Index creation. Note: Vector Index creation may take a while depending on the size of data.
56
+
:::image type="content" source="media/how-to-create-vector-index/new-vector-creation.png" alt-text="Screenshot that shows basic settings for creating a vector index.":::
64
57
58
+
1. Select your data source type.
65
59
60
+
1. Based on the chosen type, provide the location details of your source. Then, select **Next**.
66
61
67
-
## Add a Vector Index to a prompt flow
62
+
1. Review the details of your vector index, and then select the **Create** button.
68
63
69
-
Once you have created a Vector Index, you can add it to a prompt flow from the prompt flow canvas. The prompt flow designer has a Vector Index lookup tool. Add this tool to the canvas and enter the path to your Vector Index and the query you want to perform against the index. You can find the steps to do this here.
64
+
1. On the overview page that appears, you can track and view the status of creating your vector index. The process might take a while, depending on the size of your data.
70
65
66
+
## Add a vector index to a prompt flow
71
67
72
-
1. Open an existing prompt flow
68
+
After you create a vector index, you can add it to a prompt flow from the prompt flow canvas.
73
69
70
+
1. Open an existing prompt flow.
74
71
75
-
1. On the top menu, select **More Tools** and select Vector Index Lookup
72
+
1. On the top menu of the prompt flow designer, select **More tools**, and then select **Vector Index Lookup**.
76
73
77
-
:::image type="content" source="media/how-to-create-vector-index/vector-lookup.png" alt-text="Screenshot showing the location of the More Tools button.":::
74
+
:::image type="content" source="media/how-to-create-vector-index/vector-lookup.png" alt-text="Screenshot that shows the list of available tools.":::
78
75
79
-
1.The Vector Index lookup tool gets added to the canvas. If you don't see the tool immediately, scroll to the bottom of the canvas.
76
+
The Vector Index Lookup tool is added to the canvas. If you don't see the tool immediately, scroll to the bottom of the canvas.
80
77
81
-
:::image type="content" source="media/how-to-create-vector-index/vector-index-lookup-tool.png" alt-text="Screenshot showing the vector index lookup tool.":::
78
+
:::image type="content" source="media/how-to-create-vector-index/vector-index-lookup-tool.png" alt-text="Screenshot that shows the Vector Index Lookup tool.":::
82
79
83
-
1. Enter the path to your Vector Index and enter your desired query. Be sure to type in your path directly, or to paste the path.
80
+
1. Enter the path to your vector index, along with the query that you want to perform against the index.
84
81
85
82
## Next steps
86
83
87
-
[Get started with RAG using a prompt flow sample (preview)](how-to-use-pipelines-prompt-flow.md)
84
+
[Get started with RAG by using a prompt flow sample (preview)](how-to-use-pipelines-prompt-flow.md)
88
85
89
-
[Use Vector Stores](concept-vector-stores.md) with Azure Machine Learning (preview)
86
+
[Use vectorstores with Azure Machine Learning (preview)](concept-vector-stores.md)
Copy file name to clipboardExpand all lines: articles/machine-learning/includes/machine-learning-preview-generic-disclaimer.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,6 +11,6 @@ ms.custom: include file
11
11
---
12
12
13
13
> [!IMPORTANT]
14
-
> This feature is currently in public preview.
15
-
>This preview version is provided without a service-level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
14
+
> This feature is currently in public preview. This preview version is provided without a service-level agreement, and we don't recommend it for production workloads. Certain features might not be supported or might have constrained capabilities.
15
+
>
16
16
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
0 commit comments