Skip to content

Commit da6aa23

Browse files
committed
Fixed block issues
1 parent d1ab2ad commit da6aa23

12 files changed

+22
-22
lines changed

articles/machine-learning/prompt-flow/how-to-create-manage-runtime.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ To use the runtime, assigning the `AzureML Data Scientist` role of workspace to
3838
3939
## Permissions/roles for deployments
4040

41-
After deploying a prompt flow, the endpoint must be assigned the `AzureML Data Scientist` role to the workspace for successful inferencing. This can be done at any point after the endpoint has been created.
41+
After deploying a prompt flow, the endpoint must be assigned the `AzureML Data Scientist` role to the workspace for successful inferencing. This operation can be done at any point after the endpoint has been created.
4242

4343
## Create runtime in UI
4444

@@ -61,7 +61,7 @@ Automatic is the default option for runtime, you can start automatic runtime (pr
6161

6262
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-create-automatic-init.png" alt-text="Screenshot of prompt flow on the start automatic with default settings on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-create-automatic-init.png":::
6363

64-
2. Start with advanced settings, you can customize the VM size used by the runtime. You can also customize the idle time, which will delete runtime automatically if it isn't in use to save code. Meanwhile, you can set the user assigned manage identity used by automatic runtime, it will be used to pull base image (please make sure user assigned manage identity have ACR pull permission) and install packages. If you don't set it, we'll use user identity as default. Learn more about [how to create update user assigned identities to workspace](../how-to-identity-based-service-authentication.md#to-create-a-workspace-with-multiple-user-assigned-identities-use-one-of-the-following-methods).
64+
2. Start with advanced settings, you can customize the VM size used by the runtime. You can also customize the idle time, which will delete runtime automatically if it isn't in use to save code. Meanwhile, you can set the user assigned manage identity used by automatic runtime, it's used to pull base image (please make sure user assigned manage identity have ACR pull permission) and install packages. If you don't set it, we use user identity as default. Learn more about [how to create update user assigned identities to workspace](../how-to-identity-based-service-authentication.md#to-create-a-workspace-with-multiple-user-assigned-identities-use-one-of-the-following-methods).
6565

6666
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-automatic-settings.png" alt-text="Screenshot of prompt flow on the start automatic with advanced setting on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-automatic-settings.png":::
6767

@@ -74,7 +74,7 @@ If you don't have a compute instance, create a new one: [Create and manage an Az
7474
1. Select compute instance you want to use as runtime.
7575
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-ci-runtime-select-ci.png" alt-text="Screenshot of add compute instance runtime with select compute instance highlighted. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-ci-runtime-select-ci.png":::
7676
Because compute instances is isolated by user, you can only see your own compute instances or the ones assigned to you. To learn more, see [Create and manage an Azure Machine Learning compute instance](../how-to-create-compute-instance.md).
77-
1. Authenticate on the compute instance. You only need to do auth one time per region in six month.
77+
1. Authenticate on the compute instance. You only need to do auth one time per region in six months.
7878
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-authentication.png" alt-text="Screenshot of doing the authentication on compute instance. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-authentication.png":::
7979
1. Select create new custom application or existing custom application as runtime.
8080
1. Select create new custom application as runtime.
@@ -126,7 +126,7 @@ You can also customize environment used to run this flow.
126126

127127
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-create-automatic-save-install.png" alt-text="Screenshot of save and install packages for automatic runtime (preview) on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-create-automatic-save-install.png":::
128128

129-
#### Add packages in private feed in Azure devops
129+
#### Add packages in private feed in Azure DevOps
130130

131131
If you want to use private feed in Azure DevOps, add the Managed Identity in the Azure DevOps organization. To learn more, see [Use service principals & managed identities](/azure/devops/integrate/get-started/authentication/service-principal-managed-identity)
132132

@@ -140,7 +140,7 @@ You need add `{private}` to your private feed url. Such as if you want to instal
140140
test_package
141141
```
142142

143-
- By default, we'll use latest prompt flow image as base image. If you want to use a different base image, you can build custom base image learn more, see [Customize environment with docker context for runtime](how-to-customize-environment-runtime.md#customize-environment-with-docker-context-for-runtime), then you can use put it under `environment` in `flow.dag.yaml` file in flow folder. You need `reset` runtime to use the new base image, this takes several minutes as it pulls the new base image and install packages again.
143+
- By default, we use latest prompt flow image as base image. If you want to use a different base image, you can build custom base image learn more, see [Customize environment with docker context for runtime](how-to-customize-environment-runtime.md#customize-environment-with-docker-context-for-runtime), then you can use put it under `environment` in `flow.dag.yaml` file in flow folder. You need `reset` runtime to use the new base image, this takes several minutes as it pulls the new base image and install packages again.
144144

145145
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png" alt-text="Screenshot of customize environment for automatic runtime on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png":::
146146

articles/machine-learning/prompt-flow/how-to-customize-environment-runtime.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -117,11 +117,11 @@ To learn more about environment CLI, see [Manage environments](../how-to-manage-
117117

118118
## Customize environment with flow folder for automatic runtime (preview)
119119

120-
In `flow.dag.yaml` file in prompt flow folder, you can use `environment` section we can define the environment for the flow. It include two parts:
121-
- image: which is the base image for the flow, if ommitted, it will use the latest version of prompt flow base image `mcr.microsoft.com/azureml/promptflow/promptflow-runtime-stable:<newest_version>`. If you want to customize the environment, you can use the image you created in previous section.
120+
In `flow.dag.yaml` file in prompt flow folder, you can use `environment` section we can define the environment for the flow. It includes two parts:
121+
- image: which is the base image for the flow, if omitted, it uses the latest version of prompt flow base image `mcr.microsoft.com/azureml/promptflow/promptflow-runtime-stable:<newest_version>`. If you want to customize the environment, you can use the image you created in previous section.
122122
- You can also specify packages `requirements.txt`, Both automatic runtime and flow deployment from UI will use the environment defined in `flow.dag.yaml` file.
123123

124-
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png" alt-text="Screenshot of customize environment for automatic runtime on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png":::
124+
:::image type="content" source="./media/how-to-customize-environment-runtime/runtime-creation-automatic-image-flow-dag.png" alt-text="Screenshot of customize environment for automatic runtime on flow page. " lightbox = "./media/how-to-customize-environment-runtime/runtime-creation-automatic-image-flow-dag.png":::
125125

126126
If you want to use private feeds in Azure devops, see [Add packages in private feed in Azure devops](./how-to-create-manage-runtime.md#add-packages-in-private-feed-in-azure-devops).
127127

articles/machine-learning/prompt-flow/how-to-deploy-for-real-time-inference.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -60,11 +60,11 @@ When you deploy prompt flow to managed online endpoint in UI, by default the dep
6060

6161
If you are using the customer environment to create compute instance runtime, you can find the image in environment detail page in Azure Machine Learning studio. To learn more, see [Customize environment with docker context for runtime](how-to-customize-environment-runtime.md#customize-environment-with-docker-context-for-runtime).
6262

63-
:::image type="content" source="./media/how-to-customize-environment-runtime/runtime-creation-image-environment.png" alt-text="Screenshot of image name in environment detail page. " lightbox = "./media/how-to-customize-environment-runtime/runtime-creation-image-environment.png":::
63+
:::image type="content" source="./media/how-to-deploy-for-real-time-inference/runtime-creation-image-environment.png" alt-text="Screenshot of image name in environment detail page. " lightbox = "./media/how-to-deploy-for-real-time-inference/runtime-creation-image-environment.png":::
6464

6565
Then you need also specify the image to the `environment` in the `flow.dag.yaml` in flow folder.
6666

67-
:::image type="content" source="./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png" alt-text="Screenshot of customize environment for automatic runtime on flow page. " lightbox = "./media/how-to-create-manage-runtime/runtime-creation-automatic-image-flow-dag.png":::
67+
:::image type="content" source="./media/how-to-deploy-for-real-time-inference/runtime-creation-automatic-image-flow-dag.png" alt-text="Screenshot of customize environment for automatic runtime on flow page. " lightbox = "./media/how-to-deploy-for-real-time-inference/runtime-creation-automatic-image-flow-dag.png":::
6868

6969
> [!NOTE]
7070
> If you are using private feeds in Azure devops, you need [build the image with private feeds](./how-to-create-manage-runtime.md#add-packages-in-private-feed-in-azure-devops) first and select custom environment to deploy in UI.

articles/machine-learning/prompt-flow/how-to-integrate-with-llm-app-devops.md

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ ms.date: 11/02/2023
1616

1717
# Integrate prompt flow with LLM-based application DevOps
1818

19-
In this article, you'll learn about the integration of prompt flow with LLM-based application DevOps in Azure Machine Learning. Prompt flow offers a developer-friendly and easy-to-use code-first experience for flow developing and iterating with your entire LLM-based application development workflow.
19+
In this article, you learn about the integration of prompt flow with LLM-based application DevOps in Azure Machine Learning. Prompt flow offers a developer-friendly and easy-to-use code-first experience for flow developing and iterating with your entire LLM-based application development workflow.
2020

2121
It provides an **prompt flow SDK and CLI**, an **VS code extension**, and the new UI of **flow folder explorer** to facilitate the local development of flows, local triggering of flow runs and evaluation runs, and transitioning flows from local to cloud (Azure Machine Learning workspace) environments.
2222

@@ -49,10 +49,10 @@ Overview of the flow folder structure and the key files it contains:
4949
- **flow.dag.yaml**: This primary flow definition file, in YAML format, includes information about inputs, outputs, nodes, tools, and variants used in the flow. It's integral for authoring and defining the prompt flow.
5050
- **Source code files (.py, .jinja2)**: The flow folder also includes user-managed source code files, which are referred to by the tools/nodes in the flow.
5151
- Files in Python (.py) format can be referenced by the python tool for defining custom python logic.
52-
- Files in Jinja2 (.jinja2) format can be referenced by the prompt tool or LLM tool for defining prompt context.
53-
- **Non-source files**: The flow folder can also contain non-source files such as utility files and data files that can be included in the source files.
52+
- Files in Jinja 2 (.jinja2) format can be referenced by the prompt tool or LLM tool for defining prompt context.
53+
- **Non-source files**: The flow folder can also contain nonsource files such as utility files and data files that can be included in the source files.
5454

55-
Once the flow is created, you can navigate to the Flow Authoring Page to view and operate the flow files in the right file explorer. This allows you to view, edit, and manage your files. Any modifications made to the files will be directly reflected in the file share storage.
55+
Once the flow is created, you can navigate to the Flow Authoring Page to view and operate the flow files in the right file explorer. This allows you to view, edit, and manage your files. Any modifications made to the files are directly reflected in the file share storage.
5656

5757
:::image type="content" source="./media/how-to-integrate-with-llm-app-devops/flow-file-explorer.png" alt-text="Screenshot of standard flow highlighting the files explorer. " lightbox = "./media/how-to-integrate-with-llm-app-devops/flow-file-explorer.png":::
5858

@@ -68,7 +68,7 @@ Alternatively, you can access all the flow folders directly within the Azure Mac
6868

6969
## Versioning prompt flow in code repository
7070

71-
To check in your flow into your code repository, you can easily export the flow folder from the flow authoring page to your local system. This will download a package containing all the files from the explorer to your local machine, which you can then check into your code repository.
71+
To check in your flow into your code repository, you can easily export the flow folder from the flow authoring page to your local system. This downloads a package containing all the files from the explorer to your local machine, which you can then check into your code repository.
7272

7373
:::image type="content" source="./media/how-to-integrate-with-llm-app-devops/flow-export.png" alt-text="Screenshot of showing the download button in the file explorer." lightbox = "./media/how-to-integrate-with-llm-app-devops/flow-export.png":::
7474

@@ -154,7 +154,7 @@ connections:
154154
deployment_name: <deployment_name>
155155
```
156156
157-
You can specify the connection and deployment name for each tool in the flow. If you don't specify the connection and deployment name, it will use the one connection and deployment on the `flow.dag.yaml` file. To format of connections:
157+
You can specify the connection and deployment name for each tool in the flow. If you don't specify the connection and deployment name, it uses the one connection and deployment on the `flow.dag.yaml` file. To format of connections:
158158

159159
```yaml
160160
...
@@ -195,7 +195,7 @@ connections = {"classify_with_llm":
195195
base_run = pf.run(
196196
flow=flow,
197197
data=data,
198-
runtime=runtime, # if ommited, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
198+
runtime=runtime, # if omitted, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
199199
# resources = resources, # only work for automatic runtime, will be ignored if you specify the runtime name.
200200
column_mapping={
201201
"url": "${data.url}"
@@ -222,7 +222,7 @@ column_mapping:
222222
prediction: ${run.outputs.category}
223223
224224
# define cloud resource
225-
# if ommited, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
225+
# if omitted, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
226226
runtime: <runtime_name>
227227
228228
@@ -275,7 +275,7 @@ eval_run = pf.run(
275275
"groundtruth": "${data.answer}",
276276
"prediction": "${run.outputs.category}",
277277
},
278-
runtime=runtime, # if ommited, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
278+
runtime=runtime, # if omitted, it will use the automatic runtime, you can also specify the runtime name, specif automatic will also use the automatic runtime.
279279
# resources = resources, # only work for automatic runtime, will be ignored if you specify the runtime name.
280280
connections=connections
281281
)
@@ -355,7 +355,7 @@ To use the extension:
355355
1. Open a prompt flow folder in VS Code Desktop.
356356
2. Open the ```flow.dag.yaml`` file in notebook view.
357357
3. Use the visual editor to make any necessary changes to your flow, such as tune the prompts in variants, or add more tools.
358-
4. To test your flow, select the **Run Flow** button at the top of the visual editor. This will trigger a flow test.
358+
4. To test your flow, select the **Run Flow** button at the top of the visual editor. This triggers a flow test.
359359

360360
:::image type="content" source="./media/how-to-integrate-with-llm-app-devops/run-flow-visual-editor.png" alt-text="Screenshot of VS Code showing running the flow in the visual editor. " lightbox = "./media/how-to-integrate-with-llm-app-devops/run-flow-visual-editor.png":::
361361

@@ -453,7 +453,7 @@ The introduction of the prompt flow **SDK/CLI** and the **Visual Studio Code Ext
453453

454454
- The first step of this collaborative process involves using a code repository as the base for your project code, which includes the prompt flow code.
455455
- This centralized repository enables efficient organization, tracking of all code changes, and collaboration among team members.
456-
- Once the repository is set up, team members can leverage the VSC extension for local authoring and single input testing of the flow.
456+
- Once the repository is set up, team members can use the VSC extension for local authoring and single input testing of the flow.
457457
- This standardized integrated development environment fosters collaboration among multiple members working on different aspects of the flow.
458458
:::image type="content" source="media/how-to-integrate-with-llm-app-devops/prompt-flow-local-develop.png" alt-text="Screenshot of local development. " lightbox = "media/how-to-integrate-with-llm-app-devops/prompt-flow-local-develop.png":::
459459
1. Cloud-based experimental batch testing and evaluation - prompt flow CLI/SDK and workspace portal UI
@@ -467,7 +467,7 @@ The introduction of the prompt flow **SDK/CLI** and the **Visual Studio Code Ext
467467
:::image type="content" source="media/how-to-integrate-with-llm-app-devops/cloud-run-list.png" alt-text="Screenshot of run list in workspace. " lightbox = "media/how-to-integrate-with-llm-app-devops/cloud-run-list.png":::
468468
:::image type="content" source="media/how-to-integrate-with-llm-app-devops/cloud-run-compare.png" alt-text="Screenshot of run comparison in workspace. " lightbox = "media/how-to-integrate-with-llm-app-devops/cloud-run-compare.png":::
469469
1. Local iterative development or one-step UI deployment for production
470-
- Following the analysis of experiments, team members can return to the code repository for additional development and fine-tuning. Subsequent runs can then be submitted to the cloud in an iterative manner.
470+
- Following the analysis of experiments, team members can return to the code repository for another development and fine-tuning. Subsequent runs can then be submitted to the cloud in an iterative manner.
471471
- This iterative approach ensures consistent enhancement until the team is satisfied with the quality ready for production.
472472
- Once the team is fully confident in the quality of the flow, it can be seamlessly deployed via a UI wizard as an online endpoint in Azure Machine Learning. Once the team is entirely confident in the flow's quality, it can be seamlessly transitioned into production via a UI deploy wizard as an online endpoint in a robust cloud environment.
473473
- This deployment on an online endpoint can be based on a run snapshot, allowing for stable and secure serving, further resource allocation and usage tracking, and log monitoring in the cloud.
22.7 KB
Loading
9.76 KB
Loading
3.75 KB
Loading
Loading
-702 Bytes
Loading
Loading

0 commit comments

Comments
 (0)