You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-use-pipelines-prompt-flow.md
+15-3Lines changed: 15 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,9 +14,12 @@ ms.custom: prompt
14
14
---
15
15
16
16
17
-
# Use Azure Machine Learning pipelines with no code to construct RAG pipelines (preview)
17
+
# Use Azure Machine Learning pipelines to construct RAG pipelines (preview)
18
+
19
+
This tutorial walks you through how to create an RAG pipeline. The pipeline pulls a Git Repo, creates a Vector Index, automatically generates a test dataset, finds the best prompt for dataset, generates a Prompt flow and uses the test dataset to perform bulk evaluation. For advanced scenarios, you can build your own custom Azure Machine Learning pipelines from code (typically notebooks) that allows you granular control of the RAG workflow. Azure Machine Learning provides several in-built pipeline components for data chunking, embeddings generation, test data creation, automatic prompt generation, prompt evaluation. These components can be used as per your needs using notebooks. You can even use the Vector Index created in Azure Machine Learning in LangChain.
20
+
21
+
The next step is to use a Vector Index with a Large Language Model, retrieving relevant documents to augment what the model generates, while also testing multiple prompts to find the best and evaluating the performance using Prompt flow and a generated test dataset.
18
22
19
-
This tutorial walks you through how to create an RAG pipeline. For advanced scenarios, you can build your own custom Azure Machine Learning pipelines from code (typically notebooks) that allows you granular control of the RAG workflow. Azure Machine Learning provides several in-built pipeline components for data chunking, embeddings generation, test data creation, automatic prompt generation, prompt evaluation. These components can be used as per your needs using notebooks. You can even use the Vector Index created in Azure Machine Learning in LangChain.
@@ -31,6 +34,15 @@ This tutorial walks you through how to create an RAG pipeline. For advanced scen
31
34
32
35
In your Azure Machine Learning workspace, you can enable prompt flow by turn-on **Build AI solutions with Prompt flow** in the **Manage preview features** panel.
33
36
37
+
## Productionize Vector Index with Test Data Generation, Auto Prompt, Evaluations and Prompt Flow
0 commit comments