You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-create-vector-index.md
+30-37Lines changed: 30 additions & 37 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
-
title: How to create vector index in Azure Machine Learning prompt flow (preview)
2
+
title: Create a vector index in an Azure Machine Learning prompt flow (preview)
3
3
titleSuffix: Azure Machine Learning
4
-
description: How to create a vector index in Azure Machine Learning and use it in a prompt flow.
4
+
description: Learn how to create a vector index in Azure Machine Learning and use it in a prompt flow.
5
5
services: machine-learning
6
6
ms.author: balapv
7
7
author: balapv
@@ -13,74 +13,67 @@ ms.topic: how-to
13
13
ms.custom: prompt-flow
14
14
---
15
15
16
-
# How to create vector index in Azure Machine Learning prompt flow (preview)
16
+
# Create a vector index in an Azure Machine Learning prompt flow (preview)
17
17
18
-
Azure Machine Learning enables you to create a vector index from files/folders on your machine, a location in a cloud storage, an Azure Machine Learning data asset, a Git repository, or an SQL database. Azure Machine Learning can currently crack and process text files, md files, pdf, excel files, word documents. You can also reuse an existing Azure Cognitive Search Index instead of creating a new Index.
18
+
Azure Machine Learning enables you to create a vector index from files or folders on your machine, a location in cloud storage, an Azure Machine Learning data asset, a Git repository, or a SQL database. Azure Machine Learning can currently process .txt, .md, .pdf, .xls, and .docx files. You can also reuse an existing Azure Cognitive Search index instead of creating a new index.
19
19
20
-
When a Vector Index is created, Azure Machine Learning will chunk the data, create embeddings, and store the embeddings in a FAISS Index or Azure Cognitive Search Index. In addition, Azure Machine Learning creates:
20
+
When you create a vector index, Azure Machine Learning chunks the data, creates embeddings, and stores the embeddings in a Faiss index or Azure Cognitive Search index. In addition, Azure Machine Learning creates:
21
21
22
22
* Test data for your data source.
23
23
24
-
* A sample prompt flow, which uses the Vector Index you created. The sample prompt flow, which gets created has several key features like: Automatically generated prompt variants. Evaluation of each of these variations using the [test data generated](https://aka.ms/prompt_flow_blog). Metrics against each of the variants to help you choose the best variant to run. You can use this sample to continue developing your prompt.
24
+
* A sample prompt flow, which uses the vector index that you created.
25
+
26
+
The sample prompt flow has key features like automatically generated prompt variants. You can evaluate each of these variations by using the [generated test data](https://aka.ms/prompt_flow_blog). Metrics against each of the variants help you choose the best variant to run. You can use this sample to continue developing your prompt.
* An Azure subscription. If you don't have an Azure subscription, create a [free account](https://azure.microsoft.com/free/).
31
33
32
-
* Access to Azure Open AI.
33
-
34
-
* Enable prompt flow in your Azure Machine Learning workspace
35
-
36
-
In your Azure Machine Learning workspace, you can enable prompt flow by turn-on **Build AI solutions with Prompt flow** in the **Manage preview features** panel.
37
-
38
-
39
-
## Create a new Vector Index using studio
40
-
41
-
1. Select **Prompt flow** on the left menu
42
-
43
-
:::image type="content" source="media/how-to-create-vector-index/prompt.png" alt-text="Screenshot showing the Prompt flow location on the left menu.":::
44
-
45
-
1. Select **Vector Index** on the top menu
34
+
* Access to Azure OpenAI Service.
46
35
47
-
:::image type="content" source="./media/how-to-create-vector-index/vector-index.png" alt-text="Screenshot showing the Vector Index location on the top menu.":::
36
+
* Prompt flows enabled in your Azure Machine Learning workspace. You can enable prompt flows by turning on **Build AI solutions with Prompt flow** on the **Manage preview features** panel.
48
37
38
+
## Create a vector index by using Machine Learning studio
49
39
50
-
1.Select **Create**
40
+
1. Select **Prompt flow** on the left menu.
51
41
52
-
1. After the create new vectorindex form opens, provide a name for your vector index.
42
+
:::image type="content" source="media/how-to-create-vector-index/prompt.png" alt-text="Screenshot that shows the location of prompt flow on the left menu.":::
53
43
54
-
1. Next choose your data source type
44
+
1.Select the **Vector Index** tab.
55
45
56
-
:::image type="content" source="media/how-to-create-vector-index/new-vector-creation.png" alt-text="Screenshot showing the create new Vector Index form.":::
46
+
:::image type="content" source="./media/how-to-create-vector-index/vector-index.png" alt-text="Screenshot that shows the tab for vector index.":::
57
47
58
-
1. Based on the chosen type, provide the location details of your
59
-
source. Then, select **Next**.
48
+
1. Select **Create**.
60
49
61
-
1. Review the details of your vector index, then select the **Create** button to create the vector index. For more information about how to [use Vector Stores (preview).](concept-vector-stores.md)
50
+
1.In **Basic settings**, provide a name for your vector index.
62
51
63
-
1.This takes you to an overview page from where you can track and view the status of your Vector Index creation. Note: Vector Index creation may take a while depending on the size of data.
52
+
1.Select your data source type.
64
53
54
+
:::image type="content" source="media/how-to-create-vector-index/new-vector-creation.png" alt-text="Screenshot that shows basic settings for creating a vector index.":::
65
55
56
+
1. Based on the chosen type, provide the location details of your source. Then, select **Next**.
66
57
67
-
## Add a Vector Index to a prompt flow
58
+
1. Review the details of your vector index, and then select the **Create** button.
68
59
69
-
Once you have created a Vector Index, you can add it to a prompt flow from the prompt flow canvas. The prompt flow designer has a Vector Index lookup tool. Add this tool to the canvas and enter the path to your Vector Index and the query you want to perform against the index. You can find the steps to do this here.
60
+
1. On the overview page that appears, you can track and view the status of creating your vector index. The process might take a while, depending on the size of your data.
70
61
62
+
## Add a vector index to a prompt flow
71
63
72
-
1. Open an existing prompt flow
64
+
After you create a vector index, you can add it to a prompt flow from the prompt flow canvas.
73
65
66
+
1. Open an existing prompt flow.
74
67
75
-
1. On the top menu, select **More Tools** and select Vector Index Lookup
68
+
1. On the top menu of the prompt flow designer, select **More Tools**, and then select **Vector Index Lookup**.
76
69
77
-
:::image type="content" source="media/how-to-create-vector-index/vector-lookup.png" alt-text="Screenshot showing the location of the More Tools button.":::
70
+
:::image type="content" source="media/how-to-create-vector-index/vector-lookup.png" alt-text="Screenshot that shows the list of available tools.":::
78
71
79
-
1.The Vector Index lookup tool gets added to the canvas. If you don't see the tool immediately, scroll to the bottom of the canvas.
72
+
The Vector Index Lookup tool is added to the canvas. If you don't see the tool immediately, scroll to the bottom of the canvas.
80
73
81
-
:::image type="content" source="media/how-to-create-vector-index/vector-index-lookup-tool.png" alt-text="Screenshot showing the vector index lookup tool.":::
74
+
:::image type="content" source="media/how-to-create-vector-index/vector-index-lookup-tool.png" alt-text="Screenshot that shows the Vector Index Lookup tool.":::
82
75
83
-
1. Enter the path to your Vector Index and enter your desired query. Be sure to type in your path directly, or to paste the path.
76
+
1. Enter the path to your vector index, along with the query that you want to perform against the index.
Copy file name to clipboardExpand all lines: articles/machine-learning/includes/machine-learning-preview-generic-disclaimer.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,6 +11,6 @@ ms.custom: include file
11
11
---
12
12
13
13
> [!IMPORTANT]
14
-
> This feature is currently in public preview.
15
-
>This preview version is provided without a service-level agreement, and it's not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
14
+
> This feature is currently in public preview. This preview version is provided without a service-level agreement, and we don't recommend it for production workloads. Certain features might not be supported or might have constrained capabilities.
15
+
>
16
16
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
0 commit comments