You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: support/azure/azure-kubernetes/create-upgrade-delete/cannot-scale-cluster-autoscaler-enabled-node-pool.md
+26-50Lines changed: 26 additions & 50 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -3,14 +3,15 @@ title: Cluster autoscaler fails to scale with cannot scale cluster autoscaler en
3
3
description: Learn how to troubleshoot the cannot scale cluster autoscaler enabled node pool error when your autoscaler isn't scaling up or down.
4
4
author: sgeannina
5
5
ms.author: ninasegares
6
-
ms.date: 04/17/2025
7
-
ms.reviewer: aritraghosh, chiragpa.momajed
6
+
ms.date: 06/09/2024
7
+
ms.reviewer: aritraghosh, chiragpa
8
8
ms.service: azure-kubernetes-service
9
-
ms.custom: sap:Create, Upgrade, Scale and Delete operations (cluster or nodepool)
9
+
ms.custom: sap:Create, Upgrade, Scale and Delete operations (cluster or nodepool), innovation-engine
10
10
---
11
+
11
12
# Cluster autoscaler fails to scale with "cannot scale cluster autoscaler enabled node pool" error
12
13
13
-
This article discusses how to resolve the "cannot scale cluster autoscaler enabled node pool" error that occurs when you scale a cluster that has an autoscaler-enabled node pool.
14
+
This article discusses how to resolve the "cannot scale cluster autoscaler enabled node pool" error that appears when scaling a cluster with an autoscalerenabled node pool.
14
15
15
16
## Symptoms
16
17
@@ -22,75 +23,50 @@ You receive an error message that resembles the following message:
22
23
23
24
## Troubleshooting checklist
24
25
25
-
Azure Kubernetes Service (AKS) uses Azure Virtual Machine Scale Sets-based agent pools. These pools contain cluster nodes and [cluster autoscaling capabilities](/azure/aks/cluster-autoscaler), if they're enabled.
26
+
Azure Kubernetes Service (AKS) uses virtual machine scale sets-based agent pools, which contain cluster nodes and [cluster autoscaling capabilities](/azure/aks/cluster-autoscaler) if enabled.
26
27
27
28
### Check that the cluster virtual machine scale set exists
28
29
29
-
1. Sign in to the [Azure portal](https://portal.azure.com).
30
-
1. Find the node resource group by searching for the following names:
30
+
1. Sign in to [Azure portal](https://portal.azure.com).
31
+
1. Find the node resource group by searching the following names:
32
+
33
+
- The default name `MC_{AksResourceGroupName}_{YourAksClusterName}_{AksResourceLocation}`.
34
+
- The custom name (if it was provided at creation).
31
35
32
-
- The default name `MC_{AksResourceGroupName}_{YourAksClusterName}_{AksResourceLocation}`
33
-
- The custom name (if it was provided at creation)
34
-
>
35
36
> [!NOTE]
36
-
> When you create a cluster, AKS automatically creates a second resource group to store the AKS resources. For more information, see [Why are two resource groups created with AKS?](/azure/aks/faq#why-are-two-resource-groups-created-with-aks)
37
+
> When you create a new cluster, AKS automatically creates a second resource group to store the AKS resources. For more information, see [Why are two resource groups created with AKS?](/azure/aks/faq#why-are-two-resource-groups-created-with-aks)
37
38
38
-
1. Check the list of resources to make sure that a virtual machine scale set exists.
39
+
1. Check the list of resources and make sure that there's a virtual machine scale set.
39
40
40
41
## Cause 1: The cluster virtual machine scale set was deleted
41
42
42
-
If you delete the virtual machine scale set that's attached to the cluster, this action causes the cluster autoscaler to fail. It also causes issues when you provision resources such as nodes and pods.
43
+
Deleting the virtual machine scale set attached to the clustercauses the cluster autoscaler to fail. It also causes issues when provisioning resources such as nodes and pods.
43
44
44
45
> [!NOTE]
45
-
> Modifying any resource under the node resource group in the AKS cluster is an unsupported action and causes cluster operation failures. You can prevent changes from being made to the node resource group by [blocking users from modifying resources](/azure/aks/cluster-configuration#fully-managed-resource-group-preview) that are managed by the AKS cluster.
46
-
47
-
### Reconcile node pool
48
-
49
-
If the cluster virtual machine scale set is accidentally deleted, you can reconcile the node pool by using `az aks nodepool update`:
50
-
51
-
```bash
52
-
# Update Node Pool Configuration
53
-
az aks nodepool update --resource-group <resource-group-name> --cluster-name <cluster-name> --name <nodepool-name> --tags <tags> --node-taints <taints> --labels <labels>
54
-
55
-
# Verify the Update
56
-
az aks nodepool show --resource-group <resource-group-name> --cluster-name <cluster-name> --name <nodepool-name>
57
-
```
58
-
Monitor the node pool to make sure that it's functioning as expected and that all nodes are operational.
46
+
> Modifying any resource under the node resource group in the AKS cluster is an unsupported action and will cause cluster operation failures. You can prevent changes from being made to the node resource group by [blocking users from modifying resources](/azure/aks/cluster-configuration#fully-managed-resource-group-preview) managed by the AKS cluster.
59
47
60
48
## Cause 2: Tags or any other properties were modified from the node resource group
61
49
62
-
You may experience scaling errors if you modify or delete Azure-created tags and other resource properties in the node resource group. For more information, see [Can I modify tags and other properties of the AKS resources in the node resource group?](/azure/aks/faq#can-i-modify-tags-and-other-properties-of-the-aks-resources-in-the-node-resource-group)
63
-
64
-
### Reconcile node resource group tags
65
-
66
-
Use the Azure CLI to make sure that the node resource group has the correct tags for AKS name and the AKS group name:
67
-
68
-
```bash
69
-
# Add or update tags for AKS name and AKS group name
70
-
az group update --name <node-resource-group-name> --set tags.AKS-Managed-Cluster-Name=<aks-managed-cluster-name> tags.AKS-Managed-Cluster-RG=<aks-managed-cluster-rg>
71
-
72
-
# Verify the tags
73
-
az group show --name <node-resource-group-name> --query "tags"
74
-
```
75
-
Monitor the resource group to make sure that the tags are correctly applied and that the resource group is functioning as expected.
50
+
You may receive scaling errors if you modify or delete Azure-created tags and other resource properties in the node resource group. For more information, see [Can I modify tags and other properties of the AKS resources in the node resource group?](/azure/aks/faq#can-i-modify-tags-and-other-properties-of-the-aks-resources-in-the-node-resource-group)
76
51
77
52
## Cause 3: The cluster node resource group was deleted
78
53
79
-
Deleting the cluster node resource group causes issues when you provision the infrastructure resources that are required by the cluster. This action causes the cluster autoscaler to fail.
54
+
Deleting the cluster node resource group causes issues when provisioning the infrastructure resources required by the cluster, which causes the cluster autoscaler to fail.
80
55
81
56
## Solution: Update the cluster to the goal state without changing the configuration
82
57
83
-
To resolve this issue, run the following command to recover the deleted virtual machine scale set or any tags (missing or modified).
58
+
To resolve this issue, you can run the following command to recover the deleted virtual machine scale set or any tags (missing or modified):
84
59
85
60
> [!NOTE]
86
-
> It might take a few minutes until the operation finishes.
61
+
> It might take a few minutes until the operation completes.
62
+
63
+
Set your environment variables for the AKS cluster resource group and cluster name before running the command. A random suffix is included to prevent name collisions during repeatable executions, but you must ensure the resource group and cluster exist.
87
64
88
65
```azurecli
89
-
az aks update --resource-group <resource-group-name> --name <aks-cluster-name>
0 commit comments