You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- Use [managed identities to access secured resources from scoring script](tutorial-deploy-managed-endpoints-using-system-managed-identity.md)
150
-
151
148
- View costs
152
149
- Managed online endpoints let you [monitor cost at the endpoint and deployment level](how-to-view-online-endpoints-costs.md)
153
150
154
151
:::image type="content" source="media/concept-endpoints/endpoint-deployment-costs.png" alt-text="Screenshot cost chart of an endpoint and deployment":::
155
152
156
-
For a step-by-step tutorial, see [How to deploy managed online endpoints](how-to-deploy-managed-online-endpoints.md).
153
+
For a step-by-step tutorial, see [How to deploy online endpoints](how-to-deploy-managed-online-endpoints.md).
157
154
158
155
## What are batch endpoints (preview)?
159
156
@@ -197,10 +194,10 @@ Specify the storage output location to any datastore and path. By default, batch
197
194
198
195
## Next steps
199
196
200
-
-[How to deploy managed online endpoints with the Azure CLI](how-to-deploy-managed-online-endpoints.md)
197
+
-[How to deploy online endpoints with the Azure CLI](how-to-deploy-managed-online-endpoints.md)
201
198
-[How to deploy batch endpoints with the Azure CLI](how-to-use-batch-endpoint.md)
202
-
-[How to use managed online endpoints with the studio](how-to-use-managed-online-endpoint-studio.md)
199
+
-[How to use online endpoints with the studio](how-to-use-managed-online-endpoint-studio.md)
203
200
-[Deploy models with REST (preview)](how-to-deploy-with-rest.md)
204
201
-[How to monitor managed online endpoints](how-to-monitor-online-endpoints.md)
205
-
-[How to view online endpoint costs](how-to-view-online-endpoints-costs.md)
202
+
-[How to view managed online endpoint costs](how-to-view-online-endpoints-costs.md)
206
203
-[Manage and increase quotas for resources with Azure Machine Learning](how-to-manage-quotas.md#azure-machine-learning-managed-online-endpoints-preview)
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-access-resources-from-endpoints-managed-identities.md
+12-12Lines changed: 12 additions & 12 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,27 +1,27 @@
1
1
---
2
2
title: Access Azure resources from managed endpoint
3
3
titleSuffix: Azure Machine Learning
4
-
description: Securely access Azure resources for your machine learning model deployment from a managed online endpoint with a system-assigned or user-assigned managed identity.
4
+
description: Securely access Azure resources for your machine learning model deployment from an online endpoint with a system-assigned or user-assigned managed identity.
5
5
services: machine-learning
6
6
ms.service: machine-learning
7
7
ms.subservice: core
8
8
ms.author: seramasu
9
9
ms.reviewer: laobri
10
10
author: rsethur
11
-
ms.date: 10/21/2021
11
+
ms.date: 12/22/2021
12
12
ms.topic: how-to
13
13
ms.custom: devplatv2
14
14
15
-
# Customer intent: As a data scientist, I want to securely access Azure resources for my machine learning model deployment with a managed online endpoint and managed identity.
15
+
# Customer intent: As a data scientist, I want to securely access Azure resources for my machine learning model deployment with an online endpoint and managed identity.
16
16
---
17
17
18
-
# Access Azure resources from a managed online endpoint (preview) with a managed identity
18
+
# Access Azure resources from an online endpoint (preview) with a managed identity
19
19
20
-
Learn how to access Azure resources from your scoring script with a managed online endpoint and either a system-assigned managed identity or a user-assigned managed identity.
20
+
Learn how to access Azure resources from your scoring script with an online endpoint and either a system-assigned managed identity or a user-assigned managed identity.
21
21
22
22
Managed endpoints (preview) allow Azure Machine Learning to manage the burden of provisioning your compute resource and deploying your machine learning model. Typically your model needs to access Azure resources such as the Azure Container Registry or your blob storage for inferencing; with a managed identity you can access these resources without needing to manage credentials in your code. [Learn more about managed identities](../active-directory/managed-identities-azure-resources/overview.md).
23
23
24
-
This guide assumes you don't have a managed identity, a storage account or a managed online endpoint. If you already have these components, skip to the [give access permission to the managed identity](#give-access-permission-to-the-managed-identity) section.
24
+
This guide assumes you don't have a managed identity, a storage account or an online endpoint. If you already have these components, skip to the [give access permission to the managed identity](#give-access-permission-to-the-managed-identity) section.
If you encounter any issues, see [Troubleshooting managed online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md).
203
+
If you encounter any issues, see [Troubleshooting online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md).
If you encounter any issues, see [Troubleshooting managed online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md).
213
+
If you encounter any issues, see [Troubleshooting online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md).
214
214
215
215
---
216
216
@@ -271,7 +271,7 @@ Refer to the following script to understand how to use your identity token to ac
271
271
272
272
## Create a deployment with your configuration
273
273
274
-
Create a deployment that's associated with the managed endpoint. [Learn more about deploying to managed online endpoints](how-to-deploy-managed-online-endpoints.md).
274
+
Create a deployment that's associated with the managed endpoint. [Learn more about deploying to online endpoints](how-to-deploy-managed-online-endpoints.md).
275
275
276
276
>[!WARNING]
277
277
> This deployment can take approximately 8-14 minutes depending on whether the underlying environment/image is being built for the first time. Subsequent deployments using the same environment will go quicker.
@@ -360,7 +360,7 @@ If you don't plan to continue using the deployed endpoint and storage, delete th
360
360
361
361
## Next steps
362
362
363
-
* [Deploy and score a machine learning model by using a managed online endpoint (preview)](how-to-deploy-managed-online-endpoints.md).
363
+
* [Deploy and score a machine learning model by using a online endpoint (preview)](how-to-deploy-managed-online-endpoints.md).
364
364
* For more on deployment, see [Safe rollout for online endpoints (preview)](how-to-safely-rollout-managed-endpoints.md).
365
365
* For more information on using the CLI, see [Use the CLI extension for Azure Machine Learning](reference-azure-machine-learning-cli.md).
366
366
* To see which compute resources you can use, see [Managed online endpoints SKU list (preview)](reference-managed-online-endpoints-vm-sku-list.md).
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-deploy-automl-endpoint.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: Deploy an AutoML model with a managed online endpoint (preview)
2
+
title: Deploy an AutoML model with an online endpoint (preview)
3
3
titleSuffix: Azure Machine Learning
4
4
description: Learn to deploy your AutoML model as a web service that's automatically managed by Azure.
5
5
services: machine-learning
@@ -8,7 +8,7 @@ ms.subservice: core
8
8
ms.author: ssambare
9
9
ms.reviewer: laobri
10
10
author: shivanissambare
11
-
ms.date: 10/21/2021
11
+
ms.date: 12/22/2021
12
12
ms.topic: how-to
13
13
ms.custom: how-to, devplatv2
14
14
---
@@ -115,7 +115,7 @@ Create a directory called `src/` and place the scoring file you downloaded into
115
115
116
116
## Create the endpoint and deployment yaml file
117
117
118
-
To create a managed online endpoint from the command line, you'll need to create an *endpoint.yml* and a *deployment.yml* file. The following code, taken from the [Azure Machine Learning Examples repo](https://github.com/Azure/azureml-examples) shows the _endpoints/online/managed/sample/_, which captures all the required inputs:
118
+
To create an online endpoint from the command line, you'll need to create an *endpoint.yml* and a *deployment.yml* file. The following code, taken from the [Azure Machine Learning Examples repo](https://github.com/Azure/azureml-examples) shows the _endpoints/online/managed/sample/_, which captures all the required inputs:
119
119
120
120
__automl_endpoint.yml__
121
121
@@ -156,5 +156,5 @@ After you create a deployment, you can score it as described in [Invoke the endp
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-deploy-custom-container.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,5 +1,5 @@
1
1
---
2
-
title: Deploy a custom container as a managed online endpoint
2
+
title: Deploy a custom container as an online endpoint
3
3
titleSuffix: Azure Machine Learning
4
4
description: Learn how to use a custom container to use open-source servers in Azure Machine Learning.
5
5
services: machine-learning
@@ -8,14 +8,14 @@ ms.subservice: mlops
8
8
ms.author: ssambare
9
9
author: shivanissambare
10
10
ms.reviewer: larryfr
11
-
ms.date: 10/21/2021
11
+
ms.date: 12/22/2021
12
12
ms.topic: how-to
13
13
ms.custom: deploy, devplatv2
14
14
---
15
15
16
-
# Deploy a TensorFlow model served with TF Serving using a custom container in a managed online endpoint (preview)
16
+
# Deploy a TensorFlow model served with TF Serving using a custom container in an online endpoint (preview)
17
17
18
-
Learn how to deploy a custom container as a managed online endpoint in Azure Machine Learning.
18
+
Learn how to deploy a custom container as an online endpoint in Azure Machine Learning.
19
19
20
20
Custom container deployments can use web servers other than the default Python Flask server used by Azure Machine Learning. Users of these deployments can still take advantage of Azure Machine Learning's built-in monitoring, scaling, alerting, and authentication.
21
21
@@ -183,5 +183,5 @@ az ml model delete -n tfserving-mounted --version 1
183
183
## Next steps
184
184
185
185
- [Safe rollout for online endpoints (preview)](how-to-safely-rollout-managed-endpoints.md)
Copy file name to clipboardExpand all lines: articles/machine-learning/how-to-deploy-managed-online-endpoints.md
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ ms.subservice: mlops
8
8
ms.author: seramasu
9
9
ms.reviewer: laobri
10
10
author: rsethur
11
-
ms.date: 10/21/2021
11
+
ms.date: 12/22/2021
12
12
ms.topic: how-to
13
13
ms.custom: how-to, devplatv2, ignite-fall-2021
14
14
---
@@ -139,7 +139,7 @@ As noted earlier, the `code_configuration.scoring_script` must have an `init()`
139
139
140
140
## Deploy and debug locally by using local endpoints
141
141
142
-
To save time debugging, we *highly recommend* that you test-run your endpoint locally. For more, see [Debug managed online endpoints locally in Visual Studio Code](how-to-debug-managed-online-endpoints-visual-studio-code.md).
142
+
To save time debugging, we *highly recommend* that you test-run your endpoint locally. For more, see [Debug online endpoints locally in Visual Studio Code](how-to-debug-managed-online-endpoints-visual-studio-code.md).
143
143
144
144
> [!NOTE]
145
145
> * To deploy locally, [Docker Engine](https://docs.docker.com/engine/install/) must be installed.
@@ -163,7 +163,7 @@ Now, create a deployment named `blue` under the endpoint.
163
163
The `--local` flag directs the CLI to deploy the endpoint in the Docker environment.
164
164
165
165
> [!TIP]
166
-
> Use Visual Studio Code to test and debug your endpoints locally. For more information, see [debug managed online endpoints locally in Visual Studio Code](how-to-debug-managed-online-endpoints-visual-studio-code.md).
166
+
> Use Visual Studio Code to test and debug your endpoints locally. For more information, see [debug online endpoints locally in Visual Studio Code](how-to-debug-managed-online-endpoints-visual-studio-code.md).
167
167
168
168
### Verify the local deployment succeeded
169
169
@@ -200,9 +200,9 @@ In the example *score.py* file, the `run()` method logs some output to the conso
Next, deploy your managed online endpoint to Azure.
205
+
Next, deploy your online endpoint to Azure.
206
206
207
207
### Deploy to Azure
208
208
@@ -223,7 +223,7 @@ This deployment might take up to 15 minutes, depending on whether the underlying
223
223
> [!TIP]
224
224
> * If you prefer not to block your CLI console, you may add the flag `--no-wait` to the command. However, this will stop the interactive display of the deployment status.
225
225
>
226
-
> * Use [Troubleshooting managed online endpoints deployment (preview)](./how-to-troubleshoot-online-endpoints.md) to debug errors.
226
+
> * Use [Troubleshooting online endpoints deployment (preview)](./how-to-troubleshoot-online-endpoints.md) to debug errors.
227
227
228
228
### Check the status of the deployment
229
229
@@ -336,10 +336,10 @@ If you aren't going use the deployment, you should delete it by running the foll
336
336
To learn more, review these articles:
337
337
338
338
- [Deploy models with REST (preview)](how-to-deploy-with-rest.md)
339
-
- [Create and use managed online endpoints (preview) in the studio](how-to-use-managed-online-endpoint-studio.md)
339
+
- [Create and use online endpoints (preview) in the studio](how-to-use-managed-online-endpoint-studio.md)
340
340
- [Safe rollout for online endpoints (preview)](how-to-safely-rollout-managed-endpoints.md)
341
341
- [How to autoscale managed online endpoints](how-to-autoscale-endpoints.md)
342
342
- [Use batch endpoints (preview) for batch scoring](how-to-use-batch-endpoint.md)
343
343
- [View costs for an Azure Machine Learning managed online endpoint (preview)](how-to-view-online-endpoints-costs.md)
344
-
- [Access Azure resources with a managed online endpoint and managed identity (preview)](how-to-access-resources-from-endpoints-managed-identities.md)
Managed online endpoints (preview) allow you to deploy your model without having to create and manage the underlying infrastructure. In this article, you'll create an online endpoint and deployment, and validate it by invoking it. But first you'll have to register the assets needed for deployment, including model, code, and environment.
47
+
## Azure Machine Learning online endpoints
49
48
50
-
There are many ways to create an Azure Machine Learning online endpoints [including the Azure CLI](how-to-deploy-managed-online-endpoints.md), and visually with [the studio](how-to-use-managed-online-endpoint-studio.md). The following example a managed online endpoint with the REST API.
49
+
Online endpoints (preview) allow you to deploy your model without having to create and manage the underlying infrastructure as well as Kubernetes clusters. In this article, you'll create an online endpoint and deployment, and validate it by invoking it. But first you'll have to register the assets needed for deployment, including model, code, and environment.
50
+
51
+
There are many ways to create an Azure Machine Learning online endpoints [including the Azure CLI](how-to-deploy-managed-online-endpoints.md), and visually with [the studio](how-to-use-managed-online-endpoint-studio.md). The following example an online endpoint with the REST API.
51
52
52
53
## Create machine learning assets
53
54
@@ -143,8 +144,8 @@ If you aren't going use the deployment, you should delete it with the below comm
143
144
144
145
* Learn how to deploy your model [using the Azure CLI](how-to-deploy-managed-online-endpoints.md).
145
146
* Learn how to deploy your model [using studio](how-to-use-managed-online-endpoint-studio.md).
146
-
* Learn to [Troubleshoot managed online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md)
147
-
* Learn how to [Access Azure resources with a managed online endpoint and managed identity (preview)](how-to-access-resources-from-endpoints-managed-identities.md)
147
+
* Learn to [Troubleshoot online endpoints deployment and scoring (preview)](how-to-troubleshoot-managed-online-endpoints.md)
148
+
* Learn how to [Access Azure resources with a online endpoint and managed identity (preview)](how-to-access-resources-from-endpoints-managed-identities.md)
148
149
* Learn how to [monitor online endpoints](how-to-monitor-online-endpoints.md).
149
150
* Learn [Safe rollout for online endpoints (preview)](how-to-safely-rollout-managed-endpoints.md).
150
151
*[View costs for an Azure Machine Learning managed online endpoint (preview)](how-to-view-online-endpoints-costs.md).
0 commit comments