You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/aks/security-controls-policy.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,7 +1,7 @@
1
1
---
2
2
title: Azure Policy Regulatory Compliance controls for Azure Kubernetes Service (AKS)
3
3
description: Lists Azure Policy Regulatory Compliance controls available for Azure Kubernetes Service (AKS). These built-in policy definitions provide common approaches to managing the compliance of your Azure resources.
Copy file name to clipboardExpand all lines: articles/api-management/api-management-capacity.md
+30-30Lines changed: 30 additions & 30 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,103 +4,103 @@ description: This article explains what the capacity metric is and how to make i
4
4
services: api-management
5
5
documentationcenter: ''
6
6
author: dlepow
7
-
manager: anneta
8
-
editor: ''
9
7
10
8
ms.service: api-management
11
-
ms.workload: integration
12
-
ms.topic: article
13
-
ms.date: 06/18/2018
9
+
ms.topic: how-to
10
+
ms.date: 07/06/2022
14
11
ms.author: danlep
15
12
ms.custom: fasttrack-edit
16
13
---
17
14
18
15
# Capacity of an Azure API Management instance
19
16
20
-
**Capacity** is the most important [Azure Monitor metric](api-management-howto-use-azure-monitor.md#view-metrics-of-your-apis) for making informed decisions whether to scale an API Management instance to accommodate more load. Its construction is complex and imposes certain behavior.
17
+
**Capacity** is the most important [Azure Monitor metric](api-management-howto-use-azure-monitor.md#view-metrics-of-your-apis) for making informed decisions whether to [scale or upgrade](upgrade-and-scale.md) an API Management instance to accommodate more load. Its construction is complex and imposes certain behavior.
21
18
22
19
This article explains what the **capacity** is and how it behaves. It shows how to access **capacity** metrics in the Azure portal and suggests when to consider scaling or upgrading your API Management instance.
23
20
24
21
> [!IMPORTANT]
25
-
> This article discusses how you can monitor and scale your Azure API Management instance based upon its capacity metric. However, it is equally important to understand what happens when an individual API Management instance has actually *reached* its capacity. Azure API Management will not apply any service-level throttling to prevent a physical overload of the instances. When an instance reaches its physical capacity, it will behave similar to any overloaded web server that is unable to process incoming requests: latency will increase, connections will get dropped, timeout errors will occur, etc. This means that API clients should be prepared to deal with this possibility similar as with any other external service (e.g. by applying retry policies).
22
+
> This article discusses how you can monitor and scale your Azure API Management instance based upon its capacity metric. However, it is equally important to understand what happens when an individual API Management instance has actually *reached* its capacity. Azure API Management will not apply service-level throttling to prevent a physical overload of the instances. When an instance reaches its physical capacity, it will behave similar to any overloaded web server that is unable to process incoming requests: latency will increase, connections will get dropped, timeout errors will occur, and so on. This means that API clients should be prepared to deal with this possibility as they do with any other external service (for example, by applying retry policies).
26
23
27
24
## Prerequisites
28
25
29
-
To follow the steps from this article, you must have:
26
+
To follow the steps in this article, you must have:

42
39
43
-
**Capacity** is an indicator of load on an API Management instance. It reflects resources usage (CPU, memory) and network queue lengths. CPU and memory usage reveals resources consumption by:
40
+
**Capacity** is an indicator of load on an API Management instance. It reflects usage of resources (CPU, memory) and network queue lengths. CPU and memory usage reveals consumption of resources by:
44
41
45
42
+ API Management data plane services, such as request processing, which can include forwarding requests or running a policy.
46
-
+ API Management management plane services, such as management actions applied via the Azure Portal or ARM, or load coming from the [developer portal](api-management-howto-developer-portal.md).
43
+
+ API Management management plane services, such as management actions applied via the Azure portal or Azure Resource Manager, or load coming from the [developer portal](api-management-howto-developer-portal.md).
47
44
+ Selected operating system processes, including processes that involve cost of TLS handshakes on new connections.
45
+
+ Platform updates, such as OS updates on the underlying compute resources for the instance.
48
46
49
-
Total **capacity** is an average of its own values from every unit of an API Management instance.
47
+
Total **capacity** is an average of its own values from every [unit](upgrade-and-scale.md) of an API Management instance.
50
48
51
49
Although the **capacity metric** is designed to surface problems with your API Management instance, there are cases when problems won't be reflected in changes in the **capacity metric**.
52
50
53
51
## Capacity metric behavior
54
52
55
53
Because of its construction, in real life **capacity** can be impacted by many variables, for example:
56
54
57
-
+ connection patterns (new connection on a request vs reusing the existing connection)
55
+
+ connection patterns (new connection on a request versus reusing the existing connection)
58
56
+ size of a request and response
59
57
+ policies configured on each API or number of clients sending requests.
60
58
61
-
The more complex operations on the requests are, the higher the **capacity** consumption will be. For example, complex transformation policies consume much more CPU than a simple request forwarding. Slow backend service responses will increase it too.
59
+
The more complex operations on the requests are, the higher the **capacity** consumption will be. For example, complex transformation policies consume much more CPU than a simple request forwarding. Slow backend service responses will increase it, too.
62
60
63
61
> [!IMPORTANT]
64
62
> **Capacity** is not a direct measure of the number of requests being processed.
**Capacity** can also spike intermittently or be greater than zero even if there are no requests being processed. It happens because of system- or platform-specific actions and should not be taken into consideration when deciding whether to scale an instance.
66
+
**Capacity** can also spike intermittently or be greater than zero even if no requests are being processed. It happens because of system- or platform-specific actions and should not be taken into consideration when deciding whether to scale an instance.
69
67
70
68
Low **capacity metric** doesn't necessarily mean that your API Management instance isn't experiencing any problems.
1. Navigate to your APIM instance in the [Azure portal](https://portal.azure.com/).
77
-
2.Select**Metrics**.
78
-
3.From the purple section, select **Capacity** metric from available metrics and leave the default **Avg** aggregation.
74
+
1. Navigate to your API Management instance in the [Azure portal](https://portal.azure.com/).
75
+
2.In the left menu, under **Monitoring**, select**Metrics**.
76
+
3.Select the **Capacity** metric from the available metrics and leave the default **Avg** aggregation.
79
77
80
78
> [!TIP]
81
-
> You should always look at a **capacity** metric breakdown per location to avoid wrong interpretations.
79
+
> If you've deployed your instance to multiple locations, you should always look at a **capacity** metric breakdown per location to avoid wrong interpretations.
82
80
83
-
4.From the green section, select **Location**for splitting the metric by dimension.
81
+
4.To split the metric by location, from the section at the top, select **Apply splitting**and then select **Location**.
84
82
5. Pick a desired timeframe from the top bar of the section.
85
83
86
-
You can set a metric alert to let you know when something unexpected is happening. For example, get notifications when your APIM instance has been exceeding its expected peak capacity for over 20 minutes.
84
+
You can set a [metric alert](api-management-howto-use-azure-monitor.md#set-up-an-alert-rule) to let you know when something unexpected is happening. For example, get notifications when your API Management instance has exceeded its expected peak capacity for more than 20 minutes.
87
85
88
86
>[!TIP]
89
-
> You can configure alerts to let you know when your service is running low on capacity or use Azure Monitor autoscaling functionality to automatically add an Azure API Management unit. Scaling operation can take around 30 minutes, so you should plan your rules accordingly.
87
+
> You can configure alerts to let you know when your service is running low on capacity or use Azure Monitor [autoscaling](api-management-howto-autoscale.md) to automatically add an Azure API Management unit. Scaling operation can take around 30 minutes, so you should plan your rules accordingly.
90
88
> Only scaling the master location is allowed.
91
89
92
90
## Use capacity for scaling decisions
93
91
94
-
**Capacity** is the metric for making decisions whether to scale an API Management instance to accommodate more load. Consider:
92
+
**Capacity** is the metric for making decisions whether to scale an API Management instance to accommodate more load. The following are general considerations:
95
93
96
-
+ Looking at a long-term trend and average.
97
-
+ Ignoring sudden spikes that are most likely not related to any increase in load (see "Capacity metric behavior" section for explanation).
98
-
+ Upgrading or scaling your instance, when **capacity**'s value exceeds 60% or 70% for a longer period of time (for example 30 minutes). Different values may work better for your service or scenario.
94
+
+ Look at a long-term trend and average.
95
+
+ Ignore sudden spikes that are most likely not related to an increase in load (see [Capacity metric behavior](#capacity-metric-behavior) section for explanation).
96
+
+ As a general rule, upgrade or scale your instance when the **capacity** value exceeds **60% - 70%** for a long period of time (for example, 30 minutes). Different values may work better for your service or scenario.
97
+
+ If your instance is configured with only 1 unit, upgrade or scale your instance when the **capacity** value exceeds **40%** for a long period. This recommendation is based on the need to reserve capacity for guest OS updates in the underlying service platform.
99
98
100
99
>[!TIP]
101
-
> If you are able to estimate your traffic beforehand, test your APIM instance on workloads you expect. You can increase the request load on your tenant gradually and monitor what value of the capacity metric corresponds to your peak load. Follow the steps from the previous section to use Azure portal to understand how much capacity is used at any given time.
100
+
> If you are able to estimate your traffic beforehand, test your API Management instance on workloads you expect. You can increase the request load on your tenant gradually and monitor the value of the capacity metric that corresponds to your peak load. Follow the steps from the previous section to use Azure portal to understand how much capacity is used at any given time.
102
101
103
102
## Next steps
104
103
105
-
-[How to scale or upgrade an Azure API Management service instance](upgrade-and-scale.md)
106
-
-[Optimize and save on your cloud spending](../cost-management-billing/costs/quick-acm-cost-analysis.md?WT.mc_id=costmanagementcontent_docsacmhorizontal_-inproduct-learn)
104
+
-[Upgrade and scale an Azure API Management service instance](upgrade-and-scale.md)
105
+
-[Automatically scale an Azure API Management instance](api-management-howto-autoscale.md)
106
+
-[Plan and manage costs for API Management](plan-manage-costs.md)
0 commit comments