You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
|**API Version**| Required | This is the API version to be used. The current version is: api-version=2024-02-15-preview. Example: `<endpoint>/contentsafety/text:detectGroundedness?api-version=2024-02-15-preview`| String |
127
+
|**API Version**| Required | This is the API version to be used. The current version is: api-version=2024-09-15-preview. Example: `<endpoint>/contentsafety/text:detectGroundedness?api-version=2024-09-15-preview`| String |
128
128
129
129
The parameters in the request body are defined in this table:
130
130
@@ -210,7 +210,7 @@ This section walks through a sample request with cURL. Paste the command below i
210
210
211
211
212
212
```shell
213
-
curl --location --request POST '<endpoint>/contentsafety/text:detectGroundedness?api-version=2024-02-15-preview' \
213
+
curl --location --request POST '<endpoint>/contentsafety/text:detectGroundedness?api-version=2024-09-15-preview' \
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-azure-machine-learning-v2.md
+11-12Lines changed: 11 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -10,7 +10,7 @@ ms.topic: conceptual
10
10
ms.author: sgilley
11
11
author: sdgilley
12
12
ms.reviewer: balapv
13
-
ms.date: 08/21/2024
13
+
ms.date: 09/30/2024
14
14
#Customer intent: As a data scientist, I want to understand the big picture about how Azure Machine Learning works.
15
15
---
16
16
@@ -41,7 +41,7 @@ This document provides a quick overview of these resources and assets.
41
41
To use the Python SDK code examples in this article:
42
42
43
43
1. Install the [Python SDK v2](https://aka.ms/sdk-v2-install)
44
-
2. Create a connection to your Azure Machine Learning subscription. The examples all rely on `ml_client`. To create a workspace, the connection does not need a workspace name, since you may not yet have one. All other examples in this article require that the workspace name is included in the connection.
44
+
2. Create a connection to your Azure Machine Learning subscription. The examples all rely on `ml_client`. To create a workspace, the connection doesn't need a workspace name, since you may not yet have one. All other examples in this article require that the workspace name is included in the connection.
45
45
46
46
```python
47
47
# import required libraries
@@ -82,7 +82,7 @@ Sign in to [Azure Machine Learning studio](https://ml.azure.com).
82
82
83
83
## Workspace
84
84
85
-
The workspace is the top-level resource for Azure Machine Learning, providing a centralized place to work withall the artifacts you create when you use Azure Machine Learning. The workspace keeps a history of all jobs, including logs, metrics, output, and a snapshot of your scripts. The workspace stores references to resources like datastores and compute. It also holds all assets like models, environments, components and data asset.
85
+
The workspace is the top-level resource for Azure Machine Learning, providing a centralized place to work withall the artifacts you create when you use Azure Machine Learning. The workspace keeps a history of all jobs, including logs, metrics, output, and a snapshot of your scripts. The workspace stores references to resources like datastores and compute. It also holds all assets like models, environments, components,and data asset.
86
86
87
87
### Create a workspace
88
88
@@ -133,7 +133,7 @@ A compute is a designated compute resource where you run your job or host your e
133
133
134
134
***Compute instance**- a fully configured and managed development environment in the cloud. You can use the instance as a training or inference compute for development and testing. It's similar to a virtual machine on the cloud.
135
135
***Compute cluster**- a managed-compute infrastructure that allows you to easily create a cluster of CPUorGPU compute nodes in the cloud.
136
-
***Serverless compute**- a compute cluster you access on the fly. When you use serverless compute, you don't need to create your own cluster. All compute lifecycle management is offloaded to Azure Machine Learning.
136
+
***Serverless compute**- a compute cluster you access on the fly. When you use serverless compute, you don't need to create your own cluster. All compute lifecycle management is offloaded to Azure Machine Learning.
137
137
***Inference cluster**- used to deploy trained machine learning models to Azure Kubernetes Service. You can create an Azure Kubernetes Service (AKS) cluster from your Azure Machine Learning workspace, or attach an existing AKS cluster.
138
138
***Attached compute**- You can attach your own compute resources to your workspace and use them for training and inference.
139
139
@@ -171,11 +171,10 @@ az ml compute create --file my_compute.yml
171
171
```
172
172
173
173
For the content of the file, see [compute YAML examples](https://github.com/Azure/azureml-examples/tree/main/cli/resources/compute).
174
-
.
175
174
176
175
### [Studio](#tab/azure-studio)
177
176
178
-
1. Select a workspace if you are not already in one.
177
+
1. Select a workspace if you aren't already in one.
179
178
1. From the left-hand menu, select **Compute**.
180
179
1. On the top, select a tab to specify the type of compute you want to create.
181
180
1. Select **New** to create the new compute.
@@ -235,7 +234,7 @@ For the content of the file, see [datastore YAML examples](https://github.com/Az
235
234
236
235
### [Studio](#tab/azure-studio)
237
236
238
-
1. Select a workspace if you are not already in one.
237
+
1. Select a workspace if you aren't already in one.
239
238
1. From the left-hand menu, select **Data**.
240
239
1. On the top, select **Datastores**.
241
240
1. Select **Create** to create a new datastore.
@@ -246,7 +245,7 @@ To learn more about using a datastore, see [Create and manage data assets](how-t
246
245
247
246
## Model
248
247
249
-
Azure Machine Learning models consist of the binary file(s) that represent a machine learning model and any corresponding metadata. Models can be created from a local or remote file or directory. For remote locations `https`, `wasbs` and `azureml` locations are supported. The created model will be tracked in the workspace under the specified name and version. Azure Machine Learning supports three types of storage format for models:
248
+
Azure Machine Learning models consist of one or more binary files that represent a machine learning model andany corresponding metadata. Models can be created from a local or remote fileor directory. For remote locations `https`, `wasbs`and`azureml` locations are supported. The created model is tracked in the workspace under the specified name and version. Azure Machine Learning supports three types of storage formatfor models:
250
249
251
250
*`custom_model`
252
251
*`mlflow_model`
@@ -260,13 +259,13 @@ For more information on how to create models in the registry, see [Work with mod
260
259
261
260
## Environment
262
261
263
-
Azure Machine Learning environments are an encapsulation of the environment where your machine learning task happens. They specify the software packages, environment variables, and software settings around your training and scoring scripts. The environments are managed and versioned entities within your Machine Learning workspace. Environments enable reproducible, auditable, and portable machine learning workflows across a variety of computes.
262
+
Azure Machine Learning environments are an encapsulation of the environment where your machine learning task happens. They specify the software packages, environment variables, and software settings around your training and scoring scripts. The environments are managed and versioned entities within your Machine Learning workspace. Environments enable reproducible, auditable, and portable machine learning workflows across various computes.
264
263
265
264
### Types of environment
266
265
267
266
Azure Machine Learning supports two types of environments: curated and custom.
268
267
269
-
Curated environments are provided by Azure Machine Learning and are available in your workspace by default. Intended to be used as is, they contain collections of Python packages and settings to help you get started with various machine learning frameworks. These pre-created environments also allow for faster deployment time. For a full list, see the [curated environments article](resource-curated-environments.md).
268
+
Curated environments are provided by Azure Machine Learning and are available in your workspace by default. Intended to be used asis, they contain collections of Python packages and settings to help you get started with various machine learning frameworks. These precreated environments also allow for faster deployment time. For a full list, see the [curated environments article](resource-curated-environments.md).
270
269
271
270
In custom environments, you're responsible for setting up your environment and installing packages or any other dependencies that your training or scoring script needs on the compute. Azure Machine Learning allows you to create your own environment using
272
271
@@ -291,7 +290,7 @@ For more information, see [environment YAML schema](reference-yaml-environment.m
291
290
292
291
### [Studio](#tab/azure-studio)
293
292
294
-
1. Select a workspace if you are not already in one.
293
+
1. Select a workspace if you aren't already in one.
295
294
1. From the left-hand menu, select **Environments**.
296
295
1. On the top, select **Custom environments**.
297
296
1. Select **Create** to create a new custom environment.
@@ -314,7 +313,7 @@ Azure Machine Learning allows you to work with different types of data:
314
313
*`boolean`
315
314
*`number`
316
315
317
-
For most scenarios, you'll use URIs (`uri_folder` and `uri_file`) - a location in storage that can be easily mapped to the filesystem of a compute node in a job by either mounting or downloading the storage to the node.
316
+
For most scenarios, you use URIs (`uri_folder`and`uri_file`) - a location in storage that can be easily mapped to the filesystem of a compute node in a job by either mounting or downloading the storage to the node.
318
317
319
318
`mltable`is an abstraction for tabular data that is to be used for AutoML Jobs, Parallel Jobs, and some advanced scenarios. If you're just starting to use Azure Machine Learning and aren't using AutoML, we strongly encourage you to begin with URIs.
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-mlflow.md
+28-2Lines changed: 28 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.author: mopeakande
8
8
ms.reviewer: cacrest
9
9
ms.service: azure-machine-learning
10
10
ms.subservice: mlops
11
-
ms.date: 09/25/2024
11
+
ms.date: 09/30/2024
12
12
ms.topic: concept-article
13
13
ms.custom: cliv2, sdkv2, FY25Q1-Linter
14
14
#Customer intent: As a data scientist, I want to understand what MLflow is and does so that I can use MLflow with my models.
@@ -29,11 +29,37 @@ Azure Machine Learning workspaces are MLflow-compatible, which means that you ca
29
29
> [!TIP]
30
30
> Unlike the Azure Machine Learning SDK v1, there's no logging functionality in the Azure Machine Learning v2 SDK. You can use MLflow logging to ensure that your training routines are cloud-agnostic, portable, and have no dependency on Azure Machine Learning.
31
31
32
+
## What is tracking
33
+
34
+
When you work with jobs, Azure Machine Learning automatically tracks some information about experiments, such as code, environment, and input and output data. However, models, parameters, and metrics are specific to the scenario, so model builders must configure their tracking.
35
+
36
+
The saved tracking metadata varies by experiment, and can include:
37
+
38
+
- Code
39
+
- Environment details such as OS version and Python packages
40
+
- Input data
41
+
- Parameter configurations
42
+
- Models
43
+
- Evaluation metrics
44
+
- Evaluation visualizations such as confusion matrices and importance plots
45
+
- Evaluation results, including some evaluation predictions
46
+
47
+
## Benefits of tracking experiments
48
+
49
+
Whether you train models with jobs in Azure Machine Learning or interactively in notebooks, experiment tracking helps you:
50
+
51
+
- Organize all of your machine learning experiments in a single place. You can then search and filter experiments and drill down to see details about previous experiments.
52
+
- Easily compare experiments, analyze results, and debug model training.
53
+
- Reproduce or rerun experiments to validate results.
54
+
- Improve collaboration, because you can see what other teammates are doing, share experiment results, and access experiment data programmatically.
55
+
32
56
## Tracking with MLflow
33
57
58
+
Azure Machine Learning workspaces are MLflow-compatible. This compatibility means you can use MLflow to track runs, metrics, parameters, and artifacts in workspaces without needing to change your training routines or inject any cloud-specific syntax. To learn how to use MLflow for tracking experiments and runs in Azure Machine Learning workspaces, see [Track experiments and models with MLflow](how-to-use-mlflow-cli-runs.md).
59
+
34
60
Azure Machine Learning uses MLflow tracking to log metrics and store artifacts for your experiments. When you're connected to Azure Machine Learning, all MLflow tracking materializes in the workspace you're working in.
35
61
36
-
To learn how to set up MLflow tracking for experiments and training routines, see [Log metrics, parameters, and files with MLflow](how-to-log-view-metrics.md). You can also [query and compare experiments and runs with MLflow](how-to-track-experiments-mlflow.md).
62
+
To learn how to enable logging to monitor real-time run metrics with MLflow, see [Log metrics, parameters, and files with MLflow](how-to-log-view-metrics.md). You can also [query and compare experiments and runs with MLflow](how-to-track-experiments-mlflow.md).
37
63
38
64
MLflow in Azure Machine Learning provides a way to centralize tracking. You can connect MLflow to Azure Machine Learning workspaces even when you're working locally or in a different cloud. The Azure Machine Learning workspace provides a centralized, secure, and scalable location to store training metrics and models.
Copy file name to clipboardExpand all lines: articles/machine-learning/concept-v2.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,7 +9,7 @@ ms.topic: conceptual
9
9
ms.author: sgilley
10
10
author: sdgilley
11
11
ms.reviewer: balapv
12
-
ms.date: 01/17/2024
12
+
ms.date: 09/30/2024
13
13
ms.custom: cliv2, sdkv2, devx-track-python
14
14
#Customer intent: As a data scientist, I want to know whether to use v1 or v2 of CLI and SDK.
15
15
---
@@ -98,7 +98,7 @@ We encourage you to migrate your code for both CLI and SDK v1 to CLI and SDK v2.
98
98
99
99
### CLI v2
100
100
101
-
Azure Machine Learning CLI v1 has been deprecated. Support for the v1 extension will end on September 30, 2025. You will be able to install and use the v1 extension until that date.
101
+
Azure Machine Learning CLI v1 has been deprecated. Support for the v1 extension will end on September 30, 2025. You'll be able to install and use the v1 extension until that date.
102
102
103
103
We recommend that you transition to the `ml`, or v2, extension before September 30, 2025.
104
104
@@ -110,7 +110,7 @@ Azure Machine Learning Python SDK v1 doesn't have a planned deprecation date. If
110
110
* You're starting a new workflow or pipeline. All new features and future investments will be introduced in v2.
111
111
* You want to take advantage of the improved usability of the Python SDK v2 ability to compose jobs and pipelines by using Python functions, with easy evolution from simple to complex tasks.
112
112
113
-
## Next steps
113
+
## Related content
114
114
115
115
*[Upgrade from v1 to v2](how-to-migrate-from-v1.md)
0 commit comments