Skip to content

Commit 70d7022

Browse files
committed
finish migration docs; add to v1 toc
1 parent a85e783 commit 70d7022

File tree

2 files changed

+82
-15
lines changed

2 files changed

+82
-15
lines changed

articles/machine-learning/how-to-migrate-from-v1.md

Lines changed: 25 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ ms.subservice: core
88
ms.topic: how-to
99
author: s-polly
1010
ms.author: scottpolly
11-
ms.date: 06/01/2022
11+
ms.date: 09/23/2022
1212
ms.reviewer: blackmist
1313
ms.custom: devx-track-azurecli, devplatv2
1414
---
@@ -84,11 +84,14 @@ Do consider migrating the code for creating a workspace to v2. Typically Azure r
8484
> [!IMPORTANT]
8585
> If your workspace uses a private endpoint, it will automatically have the `v1_legacy_mode` flag enabled, preventing usage of v2 APIs. See [how to configure network isolation with v2](how-to-configure-network-isolation-with-v2.md) for details.
8686
87+
8788
### Connection (workspace connection in v1)
8889

8990
Workspace connections from v1 are persisted on the workspace, and fully available with v2.
9091

9192
We recommend migrating the code for creating connections to v2.
93+
For a comparison of SDK v1 and v2 code, see [Migrate workspace management from SDK v1 to SDK v2](migrate-to-v2-resource-workspace.md).
94+
9295

9396
### Datastore
9497

@@ -114,6 +117,8 @@ You can continue using your existing v1 model deployments. For new model deploym
114117
|Azure Kubernetes Service (AKS)|ACI, AKS|Manage your own AKS cluster(s) for model deployment, giving flexibility and granular control at the cost of IT overhead.|
115118
|Azure Arc Kubernetes|N/A|Manage your own Kubernetes cluster(s) in other clouds or on-premises, giving flexibility and granular control at the cost of IT overhead.|
116119

120+
For a comparison of SDK v1 and v2 code, see [Migrate deployment endpoints from SDK v1 to SDK v2](migrate-to-v2-deploy-endpoints.md).
121+
117122
### Jobs (experiments, runs, pipelines in v1)
118123

119124
In v2, "experiments", "runs", and "pipelines" are consolidated into jobs. A job has a type. Most jobs are `command` jobs that run a command, like `python main.py`. What runs in a job is agnostic to any programming language, so you can run `bash` scripts, invoke `python` interpreters, run a bunch of `curl` commands, or anything else. Another common type of job is `pipeline`, which defines child jobs that may have input/output relationships, forming a directed acyclic graph (DAG).
@@ -126,6 +131,8 @@ What you run *within* the job does not need to be migrated to v2. However, it is
126131

127132
We recommend migrating the code for creating jobs to v2. You can see [how to train models with the CLI (v2)](how-to-train-cli.md) and the [job YAML references](reference-yaml-job-command.md) for authoring jobs in v2 YAMLs.
128133

134+
For a comparison of SDK v1 and v2 code, see [Migrate script run from SDK v1 to SDK v2](migrate-to-v2-command-job.md).
135+
129136
### Data (datasets in v1)
130137

131138
Datasets are renamed to data assets. Interoperability between v1 datasets and v2 data assets is the most complex of any entity in Azure ML.
@@ -136,18 +143,34 @@ For details on data in v2, see the [data concept article](concept-data.md).
136143

137144
We recommend migrating the code for [creating data assets](how-to-create-data-assets.md) to v2.
138145

146+
For a comparison of SDK v1 and v2 code, see [Migrate data management from SDK v1 to v2](migrate-to-v2-assets-data.md).
147+
148+
139149
### Model
140150

141151
Models created from v1 can be used in v2. In v2, explicit model types are introduced. Similar to data assets, it may be easier to re-create a v1 model as a v2 model, setting the type appropriately.
142152

143153
We recommend migrating the code for creating models with [SDK](how-to-train-sdk.md) or [CLI](how-to-train-cli.md) to v2.
144154

155+
For a comparison of SDK v1 and v2 code, see
156+
157+
* [Migrate model management from SDK v1 to SDK v2](migrate-to-v2-assets-model.md)
158+
* [Migrate AutoML from SDK v1 to SDK v2](migrate-to-v2-execution-automl.md)
159+
* [Migrate hyperparameter tuning from SDK v1 to SDK v2](migrate-to-v2-execution-hyperdrive.md)
160+
* [Migrate parallel run step from SDK v1 to SDK v2](migrate-to-v2-execution-parallel-run-step.md)
161+
145162
### Environment
146163

147164
Environments created from v1 can be used in v2. In v2, environments have new features like creation from a local Docker context.
148165

149166
We recommend migrating the code for creating environments to v2.
150167

168+
## Managing secrets
169+
170+
The management of Key Vault secrets differs significantly in V2 compared to V1. The V1 set_secret and get_secret SDK methods are not available in V2. Instead, direct access using Key Vault client libraries should be used.
171+
172+
For details about Key Vault, see [Use authentication credential secrets in Azure Machine Learning training jobs](how-to-use-secrets-in-runs.md).
173+
151174
## Scenarios across the machine learning lifecycle
152175

153176
There are a few scenarios that are common across the machine learning lifecycle using Azure ML. We'll look at a few and give general recommendations for migrating to v2.
@@ -182,7 +205,7 @@ A MLOps workflow typically involves CI/CD through an external tool. It's recomme
182205

183206
The solution accelerator for MLOps with v2 is being developed at https://github.com/Azure/mlops-v2 and can be used as reference or adopted for setup and automation of the machine learning lifecycle.
184207

185-
#### A note on GitOps with v2
208+
### A note on GitOps with v2
186209

187210
A key paradigm with v2 is serializing machine learning entities as YAML files for source control with `git`, enabling better GitOps approaches than were possible with v1. For instance, you could enforce policy by which only a service principal used in CI/CD pipelines can create/update/delete some or all entities, ensuring changes go through a governed process like pull requests with required reviewers. Since the files in source control are YAML, they're easy to diff and track changes over time. You and your team may consider shifting to this paradigm as you migrate to v2.
188211

articles/machine-learning/v1/toc.yml

Lines changed: 57 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -7,20 +7,50 @@
77
- name: Architecture & terms
88
displayName: architecture, concepts, definitions, glossary
99
href: concept-azure-machine-learning-architecture.md
10-
- name: Migrate from ML Studio (classic)
11-
items:
10+
11+
- name: Migration from v1 to v2
12+
items:
1213
- name: Migration overview
13-
href: ../migrate-overview.md
14-
- name: Migrate datasets
15-
href: ../migrate-register-dataset.md
16-
- name: Rebuild experiments
17-
href: ../migrate-rebuild-experiment.md
18-
- name: Rebuild web services
19-
href: ../migrate-rebuild-web-service.md
20-
- name: Migrate client applications
21-
href: ../migrate-rebuild-integrate-with-client-app.md
22-
- name: Rebuild Execute R Script components
23-
href: ../migrate-execute-r-script.md
14+
displayName: migration
15+
href: ../how-to-migrate-from-v1.md
16+
- name: Manage resources and assets
17+
items:
18+
- name: "Workspace"
19+
displayName: migration, v1, v2
20+
href: ../migrate-to-v2-resource-workspace.md
21+
- name: "Datastore"
22+
displayName: migration, v1, v2
23+
href: ../migrate-to-v2-resource-datastore.md
24+
- name: "Data assets"
25+
displayName: migration, v1, v2
26+
href: ../migrate-to-v2-assets-data.md
27+
- name: "Model assets"
28+
displayName: migration, v1, v2
29+
href: ../migrate-to-v2-assets-model.md
30+
- name: Train a model
31+
items:
32+
- name: "Run a script"
33+
displayName: migration, v1, v2
34+
href: ../-to-v2-command-job.md
35+
- name: "Local runs"
36+
displayName: migration, v1, v2
37+
href: ../migrate-to-v2-local-runs.md
38+
- name: "AutoML"
39+
displayName: migration, v1, v2
40+
href: ../migrate-to-v2-execution-automl.md
41+
- name: "Hyperparameter tuning"
42+
displayName: migration, v1, v2
43+
href: ../migrate-to-v2-execution-hyperdrive.md
44+
- name: "Parallel run step"
45+
displayName: migration, v1, v2
46+
href: ../migrate-to-v2-execution-parallel-run-step.md
47+
- name: "Pipelines"
48+
displayName: migration, v1, v2
49+
href: ../migrate-to-v2-execution-pipeline.md
50+
- name: "Deploy endpoints"
51+
displayName: migration, v1, v2
52+
href: ../migrate-to-v2-deploy-endpoints.md
53+
2454
- name: Concepts (v1)
2555
items:
2656
- name: Model training
@@ -327,6 +357,20 @@
327357
href: how-to-debug-parallel-run-step.md
328358
- name: Reference (v1)
329359
items:
360+
- name: Migrate from ML Studio (classic)
361+
items:
362+
- name: Migration overview
363+
href: ../migrate-overview.md
364+
- name: Migrate datasets
365+
href: ../migrate-register-dataset.md
366+
- name: Rebuild experiments
367+
href: ../migrate-rebuild-experiment.md
368+
- name: Rebuild web services
369+
href: ../migrate-rebuild-web-service.md
370+
- name: Migrate client applications
371+
href: ../migrate-rebuild-integrate-with-client-app.md
372+
- name: Rebuild Execute R Script components
373+
href: ../migrate-execute-r-script.md
330374
- name: Machine learning CLI pipeline YAML reference
331375
href: reference-pipeline-yaml.md
332376
- name: Hyperparameters for AutoML computer vision tasks (v1)

0 commit comments

Comments
 (0)