You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/prompt-flow/how-to-create-manage-runtime.md
+12-10Lines changed: 12 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -20,11 +20,13 @@ Prompt flow's runtime provides the computing resources required for the applicat
20
20
> Prompt flow is currently in public preview. This preview is provided without a service-level agreement, and are not recommended for production workloads. Certain features might not be supported or might have constrained capabilities.
21
21
> For more information, see [Supplemental Terms of Use for Microsoft Azure Previews](https://azure.microsoft.com/support/legal/preview-supplemental-terms/).
22
22
23
-
## Permissions/roles need to use runtime
23
+
## Permissions/roles for runtime management
24
24
25
-
You need to assign enough permission to use runtime in Prompt flow. To assign a role, you need to have `owner` or have `Microsoft.Authorization/roleAssignments/write` permission on resource.
25
+
To create and use a runtime for Prompt flow authoring, you need to have the `AzureML Data Scientist` role in the workspace. To learn more, see [Prerequisites](#prerequisites).
26
26
27
-
To create and use runtime to author prompt flow, you need to have `AzureML Data Scientist` role in the workspace. To learn more, see [Prerequisites](#prerequisites)
27
+
## Permissions/roles for deployments
28
+
29
+
After deploying a Prompt flow, the endpoint must be assigned the `AzureML Data Scientist` role to the workspace for successful inferencing. This can be done at any point after the endpoint has been created.
28
30
29
31
## Create runtime in UI
30
32
@@ -35,12 +37,12 @@ To create and use runtime to author prompt flow, you need to have `AzureML Data
35
37
> [!IMPORTANT]
36
38
> Prompt flow is **not supported** in the workspace which has data isolation enabled. The enableDataIsolation flag can only be set at the workspace creation phase and can't be updated.
37
39
>
38
-
>Prompt flow is **not supported** in the project workspace which was created with a workspace hub. The workspace hub is a private preview feature.
40
+
>Prompt flow is **not supported** in the project workspace which was created with a workspace hub. The workspace hub is a private preview feature.
39
41
>
40
42
41
43
### Create compute instance runtime in UI
42
44
43
-
If you didn't have compute instance, create a new one: [Create and manage an Azure Machine Learning compute instance](../how-to-create-compute-instance.md).
45
+
If you do not have a compute instance, create a new one: [Create and manage an Azure Machine Learning compute instance](../how-to-create-compute-instance.md).
44
46
45
47
1. Select add compute instance runtime in runtime list page.
46
48
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-runtime-list-add.png" alt-text="Screenshot of Prompt flow on the runtime add with compute instance runtime selected. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-runtime-list-add.png":::
@@ -81,7 +83,7 @@ To use the runtime, assigning the `AzureML Data Scientist` role of workspace to
81
83
> [!NOTE]
82
84
> This operation may take several minutes to take effect.
83
85
84
-
## Using runtime in prompt flow authoring
86
+
## Using runtime in Prompt flow authoring
85
87
86
88
When you're authoring your Prompt flow, you can select and change the runtime from left top corner of the flow page.
87
89
@@ -95,21 +97,21 @@ When performing a bulk test, you can use the original runtime in the flow or cha
95
97
96
98
We regularly update our base image (`mcr.microsoft.com/azureml/promptflow/promptflow-runtime`) to include the latest features and bug fixes. We recommend that you update your runtime to the [latest version](https://mcr.microsoft.com/v2/azureml/promptflow/promptflow-runtime/tags/list) if possible.
97
99
98
-
Every time you open the runtime detail page, we'll check whether there are new versions of the runtime. If there are new versions available, you'll see a notification at the top of the page. You can also manually check the latest version by clicking the **check version** button.
100
+
Every time you open the runtime details page, we'll check whether there are new versions of the runtime. If there are new versions available, you'll see a notification at the top of the page. You can also manually check the latest version by clicking the **check version** button.
99
101
100
102
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-update-env-notification.png" alt-text="Screenshot of the runtime detail page with checkout version highlighted. " lightbox = "./media/how-to-create-manage-runtime/runtime-update-env-notification.png":::
101
103
102
104
Try to keep your runtime up to date to get the best experience and performance.
103
105
104
-
Go to runtime detail page and select update button at the top. You can change new environment to update. If you select **use default environment** to update, system will attempt to update your runtime to the latest version.
106
+
Go to the runtime details page and select the "Update" button at the top. Here you can update the environment to use in your runtime. If you select **use default environment**, system will attempt to update your runtime to the latest version.
105
107
106
108
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-update-env.png" alt-text="Screenshot of the runtime detail page with updated selected. " lightbox = "./media/how-to-create-manage-runtime/runtime-update-env.png":::
107
109
108
110
> [!NOTE]
109
-
> If you used a custom environment, you need to rebuild it using latest prompt flow image first, and then update your runtime with the new custom environment.
111
+
> If you used a custom environment, you need to rebuild it using the latest Prompt flow image first, and then update your runtime with the new custom environment.
110
112
111
113
112
114
## Next steps
113
115
114
116
-[Develop a standard flow](how-to-develop-a-standard-flow.md)
115
-
-[Develop a chat flow](how-to-develop-a-chat-flow.md)
117
+
-[Develop a chat flow](how-to-develop-a-chat-flow.md)
0 commit comments