You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-setup-mlops-github-azureml.md
+18-18Lines changed: 18 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -62,7 +62,7 @@ Before you can set up an MLOps project with AzureML, you need to set up authenti
62
62
63
63

64
64
65
-
1. Copy the following bash commands to your computer and update the **projectName**, **subscriptionId**, and **environment** variables with the values for your project. This command will also grant the **Contributor** role to the service principal in the subscription provided. This is required for Azure DevOps to properly use resources in that subscription.
65
+
1. Copy the following bash commands to your computer and update the **projectName**, **subscriptionId**, and **environment** variables with the values for your project. This command will also grant the **Contributor** role to the service principal in the subscription provided. This is required for GitHub Actions to properly use resources in that subscription.
66
66
67
67
```bash
68
68
projectName="<your project name>"
@@ -79,7 +79,7 @@ Before you can set up an MLOps project with AzureML, you need to set up authenti
79
79
80
80
1. Copy your edited commands into the Azure Shell and run them (**Ctrl** + **Shift** + **v**).
81
81
82
-
1. After running these commands, you'll be presented with information related to the service principal. Save this information to a safe location, it will be use later in the demo to configure Azure DevOps.
82
+
1. After running these commands, you'll be presented with information related to the service principal. Save this information to a safe location, you'll use it later in the demo to configure Azure DevOps.
83
83
84
84
```json
85
85
@@ -110,7 +110,7 @@ Before you can set up an MLOps project with AzureML, you need to set up authenti
110
110
111
111

112
112
113
-
1. Go through the process of creating a Service Principle (SP) selecting **Accounts in any organizational directory (Any Azure AD directory - Multitenant)** and name it **Azure-ARM-Prod-ProjectName**. Replace **ProjectName** with the name of your project so that the service principal can be uniquely identified.
113
+
1. Go through the process of creating a Service Principal (SP) selecting **Accounts in any organizational directory (Any Azure AD directory - Multitenant)** and name it **Azure-ARM-Prod-ProjectName**. Replace **ProjectName** with the name of your project so that the service principal can be uniquely identified.
114
114
115
115
1. Go to **Certificates & Secrets** and add for each SP **New client secret**, then store the value and secret separately.
116
116
@@ -124,11 +124,11 @@ Before you can set up an MLOps project with AzureML, you need to set up authenti
124
124
125
125
---
126
126
127
-
## Set up GitHub Repo
127
+
## Set up GitHub repo
128
128
129
129
1. Fork the [MLOps v2 Demo Template Repo](https://github.com/Azure/mlops-v2-gha-demo) in your GitHub organization
130
130
131
-
1. Go to https://github.com/Azure/mlops-v2-gha-demo/fork to fork the mlops v2 demo repo into your Github org. This repo has reusable mlops code that can be used across multiple projects.
131
+
1. Go to https://github.com/Azure/mlops-v2-gha-demo/fork to fork the MLOps v2 demo repo into your Github org. This repo has reusable MLOps code that can be used across multiple projects.
@@ -156,13 +156,13 @@ Before you can set up an MLOps project with AzureML, you need to set up authenti
156
156
> This finishes the prerequisite section and the deployment of the solution accelerator can happen accordingly.
157
157
158
158
159
-
## Deploying Machine Learning Project Infrastructure Using GitHub Actions
160
-
This step deploys the training pipeline to the Azure Machine Learning workspace created in the previous steps.
159
+
## Deploy machine learning project infrastructure with GitHub Actions
160
+
This step deploys the training pipeline to the Machine Learning workspace created in the previous steps.
161
161
162
162
> [!TIP]
163
163
> Make sure you understand the [Architectural Patterns](/azure/architecture/data-guide/technology-choices/machine-learning-operations-v2) of the solution accelerator before you checkout the MLOps v2 repo and deploy the infrastructure. In examples you'll use the [classical ML project type](/azure/architecture/data-guide/technology-choices/machine-learning-operations-v2#classical-machine-learning-architecture).
1. Go to your repository and select the `config-infra-prod.yml` file in the root.
167
167
168
168
This config file uses the namespace and postfix values the names of the artifacts to ensure uniqueness. Update the following section in the config to your liking. Default values and settings in the files are show below:
@@ -181,25 +181,25 @@ This step deploys the training pipeline to the Azure Machine Learning workspace
181
181
> If you are running a Deep Learning workload such as CV or NLP, ensure your GPU compute is available in your deployment zone.
182
182
> The enable_monitoring flag in these files defaults to False. Enabling this flag will add additional elements to the deployment to support Azure ML monitoring based on https://github.com/microsoft/AzureML-Observability. This will include an ADX cluster and increase the deployment time and cost of the MLOps solution.
183
183
184
-
### Deploy Azure Machine Learning Infrastructure
184
+
### Deploy Machine Learning infrastructure
185
185
186
186
1. In your GitHub project repository (ex: taxi-fare-regression), select **Actions**
This will display the pre-defined GitHub workflows associated with your project. For a classical machine learning project, the available workflows will look similar to this:
190
+
This displays the pre-defined GitHub workflows associated with your project. For a classical machine learning project, the available workflows look similar to this:
1. On the right side of the page, select**Run workflow** and selectthe branch to run the workflow on. This may deploy Dev Infrastructure if you've created a dev branch or Prod infrastructure if deploying from main. Monitor the pipline for successful completion.
198
+
1. On the right side of the page, select **Run workflow** and select the branch to run the workflow on. This may deploy Dev Infrastructure if you've created a dev branch or Prod infrastructure if deploying from main. Monitor the workflowfor successful completion.
199
199
200
200

201
201
202
-
1. When the pipeline has complete successfully, you can find your Azure ML Workspace and associated resources by logging in to the Azure Portal. Next, a model training and scoring pipelines will be deployed into the new Azure Machine Learning environment.
202
+
1. When the pipeline has complete successfully, you can find your Azure ML Workspace and associated resources by logging in to the Azure Portal. Next, a model training and scoring pipelines will be deployed into the new Machine Learning environment.
203
203
204
204
205
205
## Sample Training and Deployment Scenario
@@ -210,7 +210,7 @@ This training pipeline contains the following steps:
210
210
211
211
**Prepare Data**
212
212
- This component takes multiple taxi datasets (yellow and green) and merges/filters the data, and prepare the train/val and evaluation datasets.
213
-
- Input: Local data under ./data/ (multiple .csv files)
213
+
- Input: Local data under `./data/` (multiple .csv files)
214
214
- Output: Single prepared dataset (.csv) and train/val/test datasets.
215
215
216
216
**Train Model**
@@ -227,28 +227,28 @@ This training pipeline contains the following steps:
227
227
**Register Model**
228
228
- This component scores the model based on how accurate the predictions are in the test set.
229
229
- Input: Trained model and the deploy flag.
230
-
- Output: Registered model in Azure Machine Learning.
230
+
- Output: Registered model in Machine Learning.
231
231
232
232
## Deploying the Model Training Pipeline
233
233
234
-
Next, you will deploy the model training pipeline to your new Azure Machine Learning workspace. This pipeline will create a compute cluster instance, register a training environment defining the necessary Docker image and python packages, register a training dataset, then start the training pipeline described in the last section. When the job is complete, the trained model will be registered in the Azure ML workspace and be available for deployment.
234
+
Next, you will deploy the model training pipeline to your new Machine Learning workspace. This pipeline will create a compute cluster instance, register a training environment defining the necessary Docker image and python packages, register a training dataset, then start the training pipeline described in the last section. When the job is complete, the trained model will be registered in the Azure ML workspace and be available for deployment.
235
235
236
-
1. In your GitHub project repository (ex: taxi-fare-regression), select **Actions**
236
+
1. In your GitHub project repository (example: taxi-fare-regression), select**Actions**
1. Select the **deploy-model-training-pipeline** from the workflows listed on the left and the click **Run Workflow** to execute the model training workflow. This will take several minutes to run, depending on the compute size.
> If you want to check the output of each individual step, forexample to view output of a failed run, click a job output, and then click each stepin the job to view any output of that step.
250
250
251
-
With the trained model registered in the Azure Machine learning workspace, you are ready to deploy the model for scoring.
251
+
With the trained model registered in the Machine learning workspace, you are ready to deploy the model for scoring.
0 commit comments