You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: support/azure/azure-kubernetes/create-upgrade-delete/cannot-scale-cluster-autoscaler-enabled-node-pool.md
+47-17Lines changed: 47 additions & 17 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,14 +3,14 @@ title: Cluster autoscaler fails to scale with cannot scale cluster autoscaler en
3
3
description: Learn how to troubleshoot the cannot scale cluster autoscaler enabled node pool error when your autoscaler isn't scaling up or down.
4
4
author: sgeannina
5
5
ms.author: ninasegares
6
-
ms.date: 10/17/2023
7
-
ms.reviewer: aritraghosh, chiragpa
6
+
ms.date: 04/17/2025
7
+
ms.reviewer: aritraghosh, chiragpa.momajed
8
8
ms.service: azure-kubernetes-service
9
9
ms.custom: sap:Create, Upgrade, Scale and Delete operations (cluster or nodepool)
10
10
---
11
11
# Cluster autoscaler fails to scale with "cannot scale cluster autoscaler enabled node pool" error
12
12
13
-
This article discusses how to resolve the "cannot scale cluster autoscaler enabled node pool" error that appears when scaling a cluster with an autoscalerenabled node pool.
13
+
This article discusses how to resolve the "cannot scale cluster autoscaler enabled node pool" error that occurs when you scale a cluster that has an autoscaler-enabled node pool.
14
14
15
15
## Symptoms
16
16
@@ -22,45 +22,75 @@ You receive an error message that resembles the following message:
22
22
23
23
## Troubleshooting checklist
24
24
25
-
Azure Kubernetes Service (AKS) uses virtual machine scale sets-based agent pools, which contain cluster nodes and [cluster autoscaling capabilities](/azure/aks/cluster-autoscaler) if enabled.
25
+
Azure Kubernetes Service (AKS) uses Azure Virtual Machine Scale Sets-based agent pools. These pools contain cluster nodes and [cluster autoscaling capabilities](/azure/aks/cluster-autoscaler), if they're enabled.
26
26
27
27
### Check that the cluster virtual machine scale set exists
28
28
29
-
1. Sign in to [Azure portal](https://portal.azure.com).
30
-
1. Find the node resource group by searching the following names:
31
-
32
-
- The default name `MC_{AksResourceGroupName}_{YourAksClusterName}_{AksResourceLocation}`.
33
-
- The custom name (if it was provided at creation).
29
+
1. Sign in to the [Azure portal](https://portal.azure.com).
30
+
1. Find the node resource group by searching for the following names:
34
31
32
+
- The default name `MC_{AksResourceGroupName}_{YourAksClusterName}_{AksResourceLocation}`
33
+
- The custom name (if it was provided at creation)
34
+
>
35
35
> [!NOTE]
36
-
> When you create a new cluster, AKS automatically creates a second resource group to store the AKS resources. For more information, see [Why are two resource groups created with AKS?](/azure/aks/faq#why-are-two-resource-groups-created-with-aks)
36
+
> When you create a cluster, AKS automatically creates a second resource group to store the AKS resources. For more information, see [Why are two resource groups created with AKS?](/azure/aks/faq#why-are-two-resource-groups-created-with-aks)
37
37
38
-
1. Check the list of resources and make sure that there's a virtual machine scale set.
38
+
1. Check the list of resources to make sure that a virtual machine scale set exists.
39
39
40
40
## Cause 1: The cluster virtual machine scale set was deleted
41
41
42
-
Deleting the virtual machine scale set attached to the clustercauses the cluster autoscaler to fail. It also causes issues when provisioning resources such as nodes and pods.
42
+
If you delete the virtual machine scale set that's attached to the cluster, this action causes the cluster autoscaler to fail. It also causes issues when you provision resources such as nodes and pods.
43
43
44
44
> [!NOTE]
45
-
> Modifying any resource under the node resource group in the AKS cluster is an unsupported action and will cause cluster operation failures. You can prevent changes from being made to the node resource group by [blocking users from modifying resources](/azure/aks/cluster-configuration#fully-managed-resource-group-preview) managed by the AKS cluster.
45
+
> Modifying any resource under the node resource group in the AKS cluster is an unsupported action and causes cluster operation failures. You can prevent changes from being made to the node resource group by [blocking users from modifying resources](/azure/aks/cluster-configuration#fully-managed-resource-group-preview) that are managed by the AKS cluster.
46
+
47
+
### Reconcile node pool
48
+
49
+
If the cluster virtual machine scale set is accidentally deleted, you can reconcile the node pool by using `az aks nodepool update`:
50
+
51
+
```bash
52
+
# Update Node Pool Configuration
53
+
az aks nodepool update --resource-group <resource-group-name> --cluster-name <cluster-name> --name <nodepool-name> --tags <tags> --node-taints <taints> --labels <labels>
54
+
55
+
# Verify the Update
56
+
az aks nodepool show --resource-group <resource-group-name> --cluster-name <cluster-name> --name <nodepool-name>
57
+
```
58
+
Monitor the node pool to make sure that it's functioning as expected and that all nodes are operational.
46
59
47
60
## Cause 2: Tags or any other properties were modified from the node resource group
48
61
49
-
You may receive scaling errors if you modify or delete Azure-created tags and other resource properties in the node resource group. For more information, see [Can I modify tags and other properties of the AKS resources in the node resource group?](/azure/aks/faq#can-i-modify-tags-and-other-properties-of-the-aks-resources-in-the-node-resource-group)
62
+
You may experience scaling errors if you modify or delete Azure-created tags and other resource properties in the node resource group. For more information, see [Can I modify tags and other properties of the AKS resources in the node resource group?](/azure/aks/faq#can-i-modify-tags-and-other-properties-of-the-aks-resources-in-the-node-resource-group)
63
+
64
+
### Reconcile node resource group tags
65
+
66
+
Use the Azure CLI to make sure that the node resource group has the correct tags for AKS name and the AKS group name:
67
+
68
+
```bash
69
+
# Add or update tags for AKS name and AKS group name
70
+
az group update --name <node-resource-group-name> --set tags.AKS-Managed-Cluster-Name=<aks-managed-cluster-name> tags.AKS-Managed-Cluster-RG=<aks-managed-cluster-rg>
71
+
72
+
# Verify the tags
73
+
az group show --name <node-resource-group-name> --query "tags"
74
+
```
75
+
Monitor the resource group to make sure that the tags are correctly applied and that the resource group is functioning as expected.
50
76
51
77
## Cause 3: The cluster node resource group was deleted
52
78
53
-
Deleting the cluster node resource group causes issues when provisioning the infrastructure resources required by the cluster, which causes the cluster autoscaler to fail.
79
+
Deleting the cluster node resource group causes issues when you provision the infrastructure resources that are required by the cluster. This action causes the cluster autoscaler to fail.
54
80
55
81
## Solution: Update the cluster to the goal state without changing the configuration
56
82
57
-
To resolve this issue, you can run the following command to recover the deleted virtual machine scale set or any tags (missing or modified):
83
+
To resolve this issue, run the following command to recover the deleted virtual machine scale set or any tags (missing or modified).
58
84
59
85
> [!NOTE]
60
-
> It might take a few minutes until the operation completes.
86
+
> It might take a few minutes until the operation finishes.
61
87
62
88
```azurecli
63
89
az aks update --resource-group <resource-group-name> --name <aks-cluster-name>
64
90
```
65
91
92
+
### Additional troubleshooting tips
93
+
94
+
- Check the Azure Activity Log for any recent changes or deletions.
95
+
66
96
[!INCLUDE [Azure Help Support](../../../includes/azure-help-support.md)]
0 commit comments