Skip to content

Commit 10eac61

Browse files
committed
cx
1 parent de4cfbf commit 10eac61

File tree

1 file changed

+7
-9
lines changed

1 file changed

+7
-9
lines changed

articles/machine-learning/concept-endpoints-online.md

Lines changed: 7 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -5,12 +5,12 @@ description: Learn about online endpoints for real-time inferencing in Azure Mac
55
services: machine-learning
66
ms.service: azure-machine-learning
77
ms.subservice: inferencing
8-
ms.topic: conceptual
8+
ms.topic: concept-article
99
author: msakande
1010
ms.author: mopeakande
1111
ms.reviewer: sehan
1212
ms.custom: devplatv2
13-
ms.date: 09/18/2024
13+
ms.date: 09/23/2024
1414

1515
#Customer intent: As an ML pro, I want to understand what an online endpoint is and why I need it.
1616
---
@@ -19,9 +19,7 @@ ms.date: 09/18/2024
1919

2020
[!INCLUDE [dev v2](includes/machine-learning-dev-v2.md)]
2121

22-
This article describes online endpoints for real-time inferencing in Azure Machine Learning. Inferencing is the process of applying new input data to a machine learning model to generate outputs.
23-
24-
Azure Machine Learning allows you to perform real-time inferencing on data by using models that are deployed to *online endpoints*. While these outputs are typically called *predictions*, you can use inferencing to generate outputs for other machine learning tasks, such as classification and clustering.
22+
This article describes online endpoints for real-time inferencing in Azure Machine Learning. Inferencing is the process of applying new input data to a machine learning model to generate outputs. Azure Machine Learning allows you to perform real-time inferencing on data by using models that are deployed to *online endpoints*. While these outputs are typically called *predictions*, you can use inferencing to generate outputs for other machine learning tasks, such as classification and clustering.
2523

2624
<a name="online-endpoints"></a>
2725
Online endpoints deploy models to a web server that can return predictions under the HTTP protocol. Online endpoints can operationalize models for real-time inference in synchronous, low-latency requests, and are best used when:
@@ -44,7 +42,7 @@ To free you from the overhead of setting up and managing the underlying infrastr
4442

4543
### Managed online endpoints vs Azure Container Instances or Azure Kubernetes Service (AKS) v1
4644

47-
The following table highlights key attributes of managed online endpoints compared to Azure Container Instances and Azure Kubernetes Service (AKS) v1 solutions.
45+
Managed online endpoints are the recommended way to use online endpoints in Azure Machine Learning. The following table highlights key attributes of managed online endpoints compared to Azure Container Instances and Azure Kubernetes Service (AKS) v1 solutions.
4846

4947
|Attributes |Managed online endpoints (v2) |Container Instances or AKS (v1) |
5048
|---------|---------|---------|
@@ -68,12 +66,12 @@ Managed online endpoints can help streamline your deployment process and provide
6866
- Performs node recovery if there's a system failure.
6967

7068
- Monitoring and logs
71-
- Monitors model availability, performance, and SLA using [native integration with Azure Monitor](how-to-monitor-online-endpoints.md).
72-
- Helps debug deployments by using logs and native integration with [Log Analytics](/azure/azure-monitor/logs/log-analytics-overview).
69+
- Ability to monitor model availability, performance, and SLA using [native integration with Azure Monitor](how-to-monitor-online-endpoints.md).
70+
- Ease of debugging deployments by using logs and native integration with [Log Analytics](/azure/azure-monitor/logs/log-analytics-overview).
7371

7472
:::image type="content" source="media/concept-endpoints/log-analytics-and-azure-monitor.png" alt-text="Screenshot showing Azure Monitor graph of endpoint latency." lightbox="media/concept-endpoints/log-analytics-and-azure-monitor.png":::
7573

76-
- [Cost view monitors costs at the endpoint and deployment level](how-to-view-online-endpoints-costs.md).
74+
- [Cost analysis view allows you to monitor costs at the endpoint and deployment level](how-to-view-online-endpoints-costs.md).
7775

7876
:::image type="content" source="media/concept-endpoints/endpoint-deployment-costs.png" alt-text="Screenshot cost chart of an endpoint and deployment." lightbox="media/concept-endpoints/endpoint-deployment-costs.png":::
7977

0 commit comments

Comments
 (0)