You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/prompt-flow/how-to-end-to-end-azure-devops-with-prompt-flow.md
+12-11Lines changed: 12 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -21,7 +21,7 @@ ms.custom:
21
21
22
22
As the demand for LLM-infused applications soars, organizations need a cohesive and streamlined process to manage the end-to-end lifecycle of these apps. Generative Artificial Intelligence Operations (GenAIOps), sometimes called *LLMOps*, is a cornerstone of efficient prompt engineering and LLM-infused application development and deployment.
23
23
24
-
This article shows how Azure Machine Learning lets you integrate with Azure DevOps to automate the LLM-infused application development lifecycle with prompt flow. Prompt flow provides a streamlined and structured approach to developing LLM-infused applications. Its well-defined process and lifecycle guide you through the process of building, testing, optimizing, and deploying flows, culminating in the creation of fully functional LLM-infused solutions.
24
+
This article shows how Azure Machine Learning lets you integrate with Azure DevOps to automate the LLM-infused application development lifecycle with *prompt flow*. Prompt flow provides a streamlined and structured approach to developing LLM-infused applications. Its well-defined process and lifecycle guide you through the process of building, testing, optimizing, and deploying flows, culminating in the creation of fully functional LLM-infused solutions.
25
25
26
26
## GenAIOps prompt flow features
27
27
@@ -92,9 +92,11 @@ The rest of this article shows you how to use GenAIOps with prompt flow by follo
92
92
- An Azure subscription with the [free or paid version of Azure Machine Learning](https://azure.microsoft.com/free/).
93
93
- An Azure Machine Learning workspace.
94
94
-[Git version 2.27 or newer](https://git-scm.com/downloads) running on your local machine.
95
-
- An [Azure DevOps organization](/azure/devops/organizations/accounts/create-organization) where you have the ability to create a project and an Azure Repos source control repository. An Azure DevOps organization helps you collaborate, plan and track your work and codeissues, and set up continuous integration (CI) and continuous deployment (CD).
95
+
- An [Azure DevOps organization](/azure/devops/organizations/accounts/create-organization) where you have the ability to create a project, an Azure Repos source control repository, and Azure Pipelines pipelines. An Azure DevOps organization helps you collaborate, plan and track your work, code, and issues, and set up CI and CD.
96
96
- An understanding of [how to integrate GenAIOps with prompt flow](how-to-integrate-with-llm-app-devops.md).
97
-
- If you use Azure DevOps and Terraform to spin up infrastructure, the [Terraform extension for Azure DevOps](https://marketplace.visualstudio.com/items?itemName=ms-devlabs.custom-terraform-tasks) installed.
97
+
98
+
>[!NOTE]
99
+
>If you use Azure DevOps and Terraform to spin up infrastructure, you need the [Terraform extension for Azure DevOps](https://marketplace.visualstudio.com/items?itemName=ms-devlabs.custom-terraform-tasks) installed.
98
100
99
101
### Set up a prompt flow connection
100
102
@@ -116,7 +118,7 @@ To create a new local repository, follow the instructions at [Clone the repo](ht
116
118
117
119
An Azure service principal is a security identity that applications, services, and automation tools use to access Azure resources. The application or service authenticates with Azure to access resources on your behalf.
118
120
119
-
Create a service principal by following the instructions at [Create Azure service principal](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#create-azure-service-principal). You use this service principal to configure the Azure DevOps Services connection and to allow Azure DevOps Services to authenticate and connect to Azure services. The prompt flow experiment and evaluation job executions both run under the identity of the service principal.
121
+
Create a service principal by following the instructions at [Create an Azure service principal](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#create-azure-service-principal). You use this service principal to configure the Azure DevOps Services connection and to allow Azure DevOps Services to authenticate and connect to Azure services. The prompt flow experiment and evaluation jobs both run under the identity of the service principal.
120
122
121
123
The setup provides the service principal with **Owner** permissions so the CD pipeline can automatically provide the newly provisioned Azure Machine Learning endpoint with access to the Azure Machine Learning workspace for reading connection information. The pipeline also adds the endpoint to the key vault policy associated with the Azure Machine Learning workspace with `get` and `list` secret permissions. You can change the **Owner** permissions to **Contributor** level permissions by changing the pipeline YAML code to remove the step related to permissions.
122
124
@@ -126,20 +128,19 @@ To create a new project in the Azure DevOps UI, follow the instructions at [Crea
126
128
127
129
### Set up authentication between Azure DevOps and Azure
128
130
129
-
This step configures a new Azure DevOps service connection that stores the service principal information. The project pipelines can read the connection information by using the connection name to connect to Azure automatically.
130
-
Use the service principal you created to set up authentication between Azure DevOps and Azure services by following the instructions at [Set up authentication with Azure and Azure DevOps](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#set-up-authentication-with-azure-and-azure-devops).
131
+
This step configures a new Azure DevOps service connection that stores the service principal information. The project pipelines can read the connection information by using the connection name to connect to Azure automatically. To use the service principal you created to set up authentication between Azure DevOps and Azure services, follow the instructions at [Set up authentication with Azure and Azure DevOps](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#set-up-authentication-with-azure-and-azure-devops).
131
132
132
133
### Create an Azure DevOps variable group
133
134
134
-
To create a new variable group and add a variable related to the Azure DevOps service connection, follow the instructions at [Create an Azure DevOps variable group](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/Azure_devops_how_to_setup.md#create-an-azure-devops-variable-group). The service principal name is available to the pipelines automatically as an environment variable.
135
+
To create a new variable group and add a variable related to the Azure DevOps service connection, follow the instructions at [Create an Azure DevOps variable group](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/Azure_devops_how_to_setup.md#create-an-azure-devops-variable-group). The service principal name is then available to the pipelines automatically as an environment variable.
135
136
136
137
### Configure Azure Repos and Azure Pipelines
137
138
138
-
The example repository uses two branches, `main` and `development`, for code promotions and execution of pipelines. To set up your own local and remote repositories to use code from the example repo, follow the instructions at [Configure Azure DevOps local and remote repositories](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/Azure_devops_how_to_setup.md#configure-azure-devops-local-and-remote-repository).
139
+
The example repository uses two branches, `main` and `development`, for code promotions and pipeline execution. To set up your own local and remote repositories to use code from the example repo, follow the instructions at [Configure Azure DevOps local and remote repositories](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/Azure_devops_how_to_setup.md#configure-azure-devops-local-and-remote-repository).
139
140
140
141
You clone both the `main` and `development` branches from the example repository, and associate the code to refer to the new Azure Repos repository. Both the PR and development pipelines are configured to execute automatically based on PR creation and merge triggers.
141
142
142
-
The branch policy for the `development` branch is configured to execute the PR pipeline for any PR raised on the development branch from a feature branch. The `dev` pipeline executes when the PR merges to the development branch. The `dev` pipeline consists of both CI and CD phases.
143
+
The branch policy for the `development` branch is configured to execute the PR pipeline for any PR raised on the development branch from a feature branch. The `dev` pipeline executes when the PR merges to the development branch, and consists of both CI and CD phases.
143
144
144
145
*Human in the loop* is also implemented within the pipelines. After the CI phase in the `dev` pipeline executes, the CD phase follows after manual approval is provided in the Azure Pipelines build execution UI.
145
146
@@ -160,15 +161,15 @@ The outputs should look similar to the examples at [Example prompt run, evaluati
160
161
161
162
### Use local execution
162
163
163
-
To use the capabilities of [local execution](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#local-execution-1), follow these steps.
164
+
To use [local execution](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/Azure_devops_how_to_setup.md#local-execution) capabilities, follow these steps.
1. Create an *.env* file at the top folder level. Add lines for each connection, updating the values for the placeholders. The examples in the example repo use the AzureOpenAI connection named `aoai` and API version `2023-03-15-preview`.
172
+
1. Create an *.env* file at the top folder level. Add lines for each connection, updating the values for the placeholders. The examples in the example repo use the AzureOpenAI connection named `aoai` and API version `2024-02-01`.
172
173
173
174
```bash
174
175
aoai={ "api_key": "<api key>","api_base": "<api base or endpoint>","api_type": "azure","api_version": "2024-02-01"}
Copy file name to clipboardExpand all lines: articles/machine-learning/prompt-flow/how-to-end-to-end-llmops-with-prompt-flow.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -19,7 +19,7 @@ ms.date: 10/18/2024
19
19
20
20
As the demand for LLM-infused applications soars, organizations need a cohesive and streamlined process to manage the end-to-end lifecycle of these apps. Generative Artificial Intelligence Operations (GenAIOps), sometimes called *LLMOps*, is a cornerstone of efficient prompt engineering and LLM-infused application development and deployment.
21
21
22
-
This article shows how Azure Machine Learning lets you integrate with GitHub to automate the LLM-infused application development lifecycle with prompt flow. Prompt flow provides a streamlined and structured approach to developing LLM-infused applications. Its well-defined process and lifecycle guide you through the process of building, testing, optimizing, and deploying flows, culminating in the creation of fully functional LLM-infused solutions.
22
+
This article shows how Azure Machine Learning lets you integrate with GitHub to automate the LLM-infused application development lifecycle with *prompt flow*. Prompt flow provides a streamlined and structured approach to developing LLM-infused applications. Its well-defined process and lifecycle guide you through the process of building, testing, optimizing, and deploying flows, culminating in the creation of fully functional LLM-infused solutions.
23
23
24
24
## GenAIOps prompt flow features
25
25
@@ -128,15 +128,15 @@ The outputs should look similar to the examples at [Example prompt run, evaluati
128
128
129
129
### Use local execution
130
130
131
-
To use the capabilities of [local execution](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#local-execution-1), follow these steps.
131
+
To use [local execution](https://github.com/microsoft/genaiops-promptflow-template/blob/main/docs/github_workflows_how_to_setup.md#local-execution-1) capabilities, follow these steps.
1. Create an *.env* file at the top folder level. Add lines for each connection, updating the values for the placeholders. The examples in the example repo use the AzureOpenAI connection named `aoai` and API version `2023-03-15-preview`.
139
+
1. Create an *.env* file at the top folder level. Add lines for each connection, updating the values for the placeholders. The examples in the example repo use the AzureOpenAI connection named `aoai` and API version `2024-02-01`.
140
140
141
141
```bash
142
142
aoai={ "api_key": "<api key>","api_base": "<api base or endpoint>","api_type": "azure","api_version": "2024-02-01"}
0 commit comments