Skip to content

Commit 67a610c

Browse files
Merge pull request #226632 from dem108/patch-18
Clarify difference between Managed and K8s
2 parents 6d5c35a + ac83ea4 commit 67a610c

File tree

1 file changed

+10
-8
lines changed

1 file changed

+10
-8
lines changed

articles/machine-learning/concept-endpoints.md

Lines changed: 10 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ author: dem108
1010
ms.author: sehan
1111
ms.reviewer: mopeakande
1212
ms.custom: devplatv2, ignite-fall-2021, event-tier1-build-2022, ignite-2022
13-
ms.date: 05/24/2022
13+
ms.date: 02/07/2023
1414
#Customer intent: As an MLOps administrator, I want to understand what a managed endpoint is and why I need it.
1515
---
1616

@@ -140,14 +140,16 @@ The following table highlights the key differences between managed online endpoi
140140
| | Managed online endpoints | Kubernetes online endpoints |
141141
| ----------------------------- | --------------------------------------------------------------------------------------------------------------------------------- | ----------------------------------------------------------------------------------------------------------------------- |
142142
| **Recommended users** | Users who want a managed model deployment and enhanced MLOps experience | Users who prefer Kubernetes and can self-manage infrastructure requirements |
143-
| **Infrastructure management** | Managed compute provisioning, scaling, host OS image updates, and security hardening | User responsibility |
144-
| **Compute type** | Managed (AmlCompute) | Kubernetes cluster (Kubernetes) |
145-
| **Out-of-box monitoring** | [Azure Monitoring](how-to-monitor-online-endpoints.md) <br> (includes key metrics like latency and throughput) | Supported |
146-
| **Out-of-box logging** | [Azure Logs and Log Analytics at endpoint level](how-to-deploy-managed-online-endpoints.md#optional-integrate-with-log-analytics) | Unsupported |
147-
| **Application Insights** | Supported | Supported |
143+
| **Node provisioning** | Managed compute provisioning, update, removal | User responsibility |
144+
| **Node maintenance** | Managed host OS image updates, and security hardening | User responsibility |
145+
| **Cluster sizing (scaling)** | [Managed manual and autoscale](how-to-autoscale-endpoints.md), supporting additional nodes provisioning | [Manual and autoscale](v1/how-to-deploy-azure-kubernetes-service.md#autoscaling), supporting scaling the number of replicas within fixed cluster boundaries |
146+
| **Compute type** | Managed by the service | Customer-managed Kubernetes cluster (Kubernetes) |
148147
| **Managed identity** | [Supported](how-to-access-resources-from-endpoints-managed-identities.md) | Supported |
149-
| **Virtual Network (VNET)** | [Supported](how-to-secure-online-endpoint.md) | Supported |
150-
| **View costs** | [Endpoint and deployment level](how-to-view-online-endpoints-costs.md) | Cluster level |
148+
| **Virtual Network (VNET)** | [Supported via managed network isolation](how-to-secure-online-endpoint.md) | User responsibility |
149+
| **Out-of-box monitoring & logging** | [Azure Monitor and Log Analytics powered](how-to-monitor-online-endpoints.md) (includes key metrics and log tables for endpoints and deployments) | User responsibility |
150+
| **Logging with Application Insights (legacy)** | Supported | Supported |
151+
| **View costs** | [Detailed to endpoint / deployment level](how-to-view-online-endpoints-costs.md) | Cluster level |
152+
| **Cost applied to** | VMs assigned to the deployments | VMs assigned to the cluster |
151153
| **Mirrored traffic** | [Supported](how-to-safely-rollout-online-endpoints.md#test-the-deployment-with-mirrored-traffic-preview) (preview) | Unsupported |
152154
| **No-code deployment** | Supported ([MLflow](how-to-deploy-mlflow-models-online-endpoints.md) and [Triton](how-to-deploy-with-triton.md) models) | Supported ([MLflow](how-to-deploy-mlflow-models-online-endpoints.md) and [Triton](how-to-deploy-with-triton.md) models) |
153155

0 commit comments

Comments
 (0)