You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-foundry/how-to/flow-tune-prompts-using-variants.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.custom:
8
8
- ignite-2023
9
9
- build-2024
10
10
ms.topic: how-to
11
-
ms.date: 5/21/2024
11
+
ms.date: 3/31/2025
12
12
ms.reviewer: none
13
13
ms.author: lagayhar
14
14
author: lgayhardt
@@ -53,7 +53,7 @@ Benefits of using variants include:
53
53
In this article, we use **Web Classification** sample flow as example.
54
54
55
55
1. Open the sample flow and remove the **prepare_examples** node as a start.
56
-
1. Under *Tools* select **Prompt flow**.
56
+
1. Under *Build and customize* select **Prompt flow**.
57
57
2. Select **Create** to open the flow creation wizard.
58
58
3. In the flow gallery under *Explore gallery* in the "Web Classification" box select **Clone**.
59
59
4. In the flow tab, delete the **prepare_examples** node.
@@ -67,7 +67,7 @@ The classification will be based on the url, the webpage text content summary, o
67
67
For a given URL : {{url}}, and text content: {{text_content}}.
68
68
Classify above url to complete the category and indicate evidence.
69
69
70
-
The output shoule be in this format: {"category": "App", "evidence": "Both"}
70
+
The output should be in this format: {"category": "App", "evidence": "Both"}
71
71
OUTPUT:
72
72
```
73
73
@@ -147,7 +147,7 @@ When you run the variants with a few single pieces of data and check the results
147
147
You can submit a batch run, which allows you test the variants with a large amount of data and evaluate them with metrics, to help you find the best fit.
148
148
149
149
1. First you need to prepare a dataset, which is representative enough of the real-world problem you want to solve with Prompt flow. In this example, it's a list of URLs and their classification ground truth. We use accuracy to evaluate the performance of variants.
150
-
2. Select **Evaluate** on the top right of the page.
150
+
2. Select **Evaluate** on the top right of the page then select **Custom Evaluation**.
151
151
3. A wizard for **Batch run & Evaluate** occurs. The first step is to select a node to run all its variants.
152
152
153
153
To test how different variants work for each node in a flow, you need to run a batch run for each node with variants one by one. This helps you avoid the influence of other nodes' variants and focus on the results of this node's variants. This follows the rule of the controlled experiment, which means that you only change one thing at a time and keep everything else the same.
0 commit comments