You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: AKS-Hybrid/aks-troubleshoot.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,7 +16,7 @@ This article describes how to find solutions for issues you encounter when using
16
16
17
17
## Open a support request
18
18
19
-
See the [Get support](/azure/aks/hybrid/help-support?tabs=aksee) article for information about how to use the Azure portal to get support or open a support request for AKS Edge Essentials.
19
+
See the [get support](/azure/aks/hybrid/help-support?tabs=aksee) article for information about how to use the Azure portal to get support or open a support request for AKS Arc.
20
20
21
21
## Upgrade
22
22
@@ -28,5 +28,5 @@ If you continually see an [Azure Advisor](/azure/advisor/) upgrade recommendatio
28
28
- If you use any of the Azure SDKs, ensure that you are using the latest version of that SDK. You can find the Azure SDKs by searching for "HybridContainerService" on the [Azure SDK releases](https://azure.github.io/azure-sdk/) page.
29
29
30
30
## Next steps
31
-
32
-
-[AKS enabled by Azure Arc known issues](aks-known-issues.md)
description: Learn how to troubleshoot troubleshoot K8sVersionValidation error code
4
4
ms.topic: troubleshooting
5
5
author: sethmanheim
6
6
ms.author: sethm
7
7
ms.date: 10/02/2024
8
-
ms.reviewer: sumsmith
8
+
ms.reviewer: abha
9
9
10
10
---
11
11
12
-
# Troubleshoot no K8s versions or VM sizes listed when you create an AKS Arc cluster
12
+
# Troubleshoot K8sVersionValidation error code
13
13
14
-
The **kubernetesVersions/default** or the **skus/default** resource in Azure is not yet created, or was deleted for some reason. This scenario can happen in older releases when the default resource was not created as a part of the deployment.
14
+
This article discusses how to identify and resolve the K8sVersionValidation error code that occurs when you try to create and deploy an AKS cluster on Azure Local.
15
15
16
-
## Workaround
16
+
## Symptoms
17
17
18
-
Run the following command:
18
+
When you try to create an AKS Arc cluster, you receive one of the following error message(s):
19
+
20
+
> "Kubernetes version 1.27.7 is not ready for use on Linux. Please go to https://aka.ms/aksarccheckk8sversions for details of how to check the readiness of Kubernetes versions"
21
+
22
+
OR
23
+
24
+
> Kubernetes version 1.26.12 is not supported. Please go to https://aka.ms/aksarcsupportedversions for details about the supported Kubernetes version on this platform.
25
+
26
+
OR
27
+
28
+
> Admission webhook \'vhybridakscluster.kb.io\' denied the request: Kubernetes version 1.26.12 is not available"
29
+
30
+
31
+
## Error messages
32
+
33
+
### Kubernetes version 1.27.7 is not ready for use on Linux. Please go to https://aka.ms/aksarccheckk8sversions for details of how to check the readiness of Kubernetes versions
34
+
35
+
#### Linux VHD download has not completed
36
+
37
+
When you install Azure Local, you download a Linux VHD of approximately 4-5GB in size. This Linux VHD is used to create the underlying VMs for the Kubernetes nodes in your AKS Arc cluster. One cause of the error message is if your Linux VHD has not finished downloading. To resolve this issue, you should wait sometime based on how long it takes for your internet connection to finish downloading the Linux VHD image.
38
+
39
+
To check if the image download is in progress or has finished, run the below command:
# Get the kubernetes version using CLI (it automatically creates the **kubernetesVersions/default** Azure resource).
45
+
46
+
az aksarc get-versions --custom-location $cl_id
47
+
```
48
+
49
+
If the above command says that the K8s versions are ready, and you're running Azure Local, [release 2411](/azure/aks/hybrid/aks-whats-new-23h2#release-2411) or newer, file a [support request](help-support.md).
50
+
51
+
If you're running Azure Local, release 2408 or older, proceed to the below section. **We highly recommend you upgrade your Azure Local deployment to the latest version to get the latest bug fixes and security updates.**
52
+
53
+
#### Recreate **kubernetesVersions/default**
54
+
55
+
If you redeploy Azure Local with the same name and parameters, you may have to recreate the **kubernetesVersions/default**. You can run the following commands to do so:
az rest --headers "Authorization=Bearer $token" "Content-Type=application/json;charset=utf-8" --uri $url --method GET
68
+
69
+
# Delete the Kubernetes version Azure resource
70
+
az rest --headers "Authorization=Bearer $token" "Content-Type=application/json;charset=utf-8" --uri $url --method DELETE
71
+
72
+
# Get the Kubernetes version using CLI (it automatically creates the Kubernetes version Azure resource)
73
+
az aksarc get-versions --custom-location $cl_id
74
+
```
75
+
76
+
#### I cannot see the Kubernetes versions or VM size options on the Azure portal
77
+
78
+
This scenario can happen in Azure Local releases 2408 or older, when the default resource for Kubernetes version (or VM sizes) was not created as a part of the Azure Local deployment.
# Get the kubernetes version or the VM sizes using CLI (it automatically creates the **kubernetesVersions/default** or the **skus/default** azure resource).
85
+
# Get the kubernetes version using CLI (it automatically creates the **kubernetesVersions/default** Azure resource).
24
86
25
87
az aksarc get-versions --custom-location $cl_id
26
-
az aksarc vmsize list --custom-location $cl_id
27
88
```
28
89
29
-
##Validation
90
+
### Kubernetes version 1.26.12 is not supported. Please go to https://aka.ms/aksarcsupportedversions for details about the supported Kubernetes version on this platform.
30
91
31
-
Verify that the portal displays the correct list of supported K8s versions and VM sizes. See [this list of supported K8s versions](aks-whats-new-23h2.md#release-2408) for each Azure Local release.
92
+
Azure Local supports specific Kubernetes versions in each of its releases. As stated in the error message, navigate to https://aka.ms/aksarcsupportedversions for list of supported Kubernetes versions based on your deployed Azure Local release.
32
93
33
94
## Next steps
34
95
35
-
[Known issues in AKS enabled by Azure Arc](aks-known-issues.md)
96
+
[Troubleshoot issues in AKS enabled by Azure Arc](aks-troubleshoot.md)
Copy file name to clipboardExpand all lines: AKS-Hybrid/supported-kubernetes-versions.md
+35-32Lines changed: 35 additions & 32 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -7,18 +7,16 @@ ms.date: 05/29/2024
7
7
author: sethmanheim
8
8
ms.author: sethm
9
9
ms.lastreviewed: 1/14/2022
10
-
ms.reviewer: mikek
10
+
ms.reviewer: abha
11
11
12
12
# Intent: As an IT Pro, I want to know how Kubernetes versions are supported, as well as the lifecycle of clusters in AKS enabled by Azure Arc.
13
13
# Keyword: supported Kubernetes versions
14
14
15
15
---
16
16
17
-
# Supported Kubernetes versions in AKS
17
+
# Supported Kubernetes versions in AKS Arc
18
18
19
-
This article describes the supported Kubernetes versions for Azure Kubernetes Service enabled by Azure Arc. The Kubernetes community releases minor versions roughly every three months. Recently, the Kubernetes community [increased the support window for each version from nine months to 12 months](https://kubernetes.io/blog/2020/08/31/kubernetes-1-19-feature-one-year-support/), starting with version 1.19.
20
-
21
-
Minor version releases include new features and improvements. Patch releases are more frequent (sometimes weekly) and are intended for critical bug fixes within a minor version. Patch releases include fixes for security vulnerabilities or major bugs.
19
+
This article describes the supported Kubernetes versions for Azure Kubernetes Service enabled by Azure Arc. AKS Arc releases new Kubernetes minor versions roughly every three months.
22
20
23
21
## Kubernetes versions
24
22
@@ -28,8 +26,8 @@ Kubernetes uses the standard [Semantic Versioning](https://semver.org/) versioni
28
26
[major].[minor].[patch]
29
27
30
28
Example:
31
-
1.17.7
32
-
1.17.8
29
+
1.29.2
30
+
1.29.5
33
31
```
34
32
35
33
Each number in the version indicates general compatibility with the previous version:
@@ -38,14 +36,27 @@ Each number in the version indicates general compatibility with the previous ver
38
36
***Minor versions** change when functionality updates are made that are backwards compatible to the other minor releases.
39
37
***Patch versions** change when backwards-compatible bug fixes are made.
40
38
41
-
You should install the latest patch release of the minor version you're running. For example, if your production cluster is on **`1.17.7`**. **`1.17.8`** is the latest available patch version available for the *1.17* series. You should upgrade to **`1.17.8`** as soon as possible to ensure your cluster is fully patched and supported.
39
+
You should install the latest patch release of the minor version you're running. For example, if your production cluster is on **`1.29.2`**. **`1.29.5`** is the latest available patch version available for the *1.29* series. You should upgrade to **`1.29.5`** as soon as possible to ensure your Kubernetes cluster is fully patched and supported.
40
+
41
+
## AKS Arc Kubernetes release calendar
42
+
43
+
View the current supported Kubernetes version releases on AKS Arc.
44
+
45
+
| K8s version | Supported Azure Local versions | Current status | Last release with Kubernetes patch/CVE updates |
| 1.29 |[2411](aks-whats-new-23h2.md#features-and-improvements), [2408](aks-whats-new-23h2.md#release-2408)| Generally available | TBD |
49
+
| 1.28 |[2411](aks-whats-new-23h2.md#features-and-improvements), [2408](aks-whats-new-23h2.md#release-2408), [2405](aks-whats-new-23h2.md#release-2405)| Generally available | TBD |
50
+
| 1.27 |[2411](aks-whats-new-23h2.md#features-and-improvements), [2408](aks-whats-new-23h2.md#release-2408), [2405](aks-whats-new-23h2.md#release-2405), 2402 | Generally available | 2502 release |
51
+
| 1.26 |[2405](aks-whats-new-23h2.md#release-2405), 2402 and older | No more patch versions/CVE updates | 2405 release |
52
+
42
53
43
54
## Kubernetes version support policy
44
55
45
56
AKS defines a generally available (GA) version as a version that's available for download when deploying or updating AKS enabled by Arc. AKS supports three GA minor versions of Kubernetes:
46
57
47
58
* The latest GA minor version that is released for AKS (which we refer to as N).
48
-
* Two previous minor versions. Each supported minor version also supports a maximum of two (2) stable patches.
59
+
* Two previous minor versions. Each supported minor version also supports stable patches.
49
60
50
61
AKS might also support preview versions, which are explicitly labeled as such.
51
62
@@ -54,24 +65,19 @@ AKS might also support preview versions, which are explicitly labeled as such.
54
65
55
66
The supported window of Kubernetes versions on AKS is known as "N-2": (N (Latest release) - 2 (minor versions)).
56
67
57
-
For example, if AKS introduces **1.17.a** today, support is provided for the following versions:
68
+
For example, if AKS introduces **1.30** today, support is provided for the following versions:
Where ".letter" is representative of patch versions.
72
+
1.30 | 1.30, 1.29, 1.28
64
73
65
74
When a new minor version is introduced, the oldest minor version and patch releases supported are deprecated and removed. For example, the current supported version list is:
66
75
67
-
* 1.17.a
68
-
* 1.17.b
69
-
* 1.16.c
70
-
* 1.16.d
71
-
* 1.15.e
72
-
* 1.15.f
76
+
* 1.29
77
+
* 1.28
78
+
* 1.27
73
79
74
-
When AKS releases 1.18.\*, all the 1.15.\* versions are removed and go out of support in 30 days.
80
+
When AKS releases 1.30.\*, all the 1.27.\* versions are removed and go out of support in 30 days.
75
81
76
82
> [!NOTE]
77
83
> If you're running an unsupported Kubernetes version, you are asked to upgrade when requesting support for the cluster. Clusters running unsupported Kubernetes releases are not covered by the [AKS support policies](./support-policies.md).
@@ -81,24 +87,23 @@ In addition to this policy, AKS supports a maximum of two patch releases of a gi
81
87
```output
82
88
Current Supported Version List
83
89
------------------------------
84
-
1.17.8, 1.17.7, 1.16.10, 1.16.9
90
+
1.29.8, 1.29.7, 1.28.10, 1.28.9
85
91
```
86
92
87
-
If AKS releases 1.17.9 and 1.16.11, the oldest patch versions are deprecated and removed, and the supported version list becomes:
93
+
If AKS releases 1.29.9 and 1.28.11, the oldest patch versions are deprecated and removed, and the supported version list becomes:
88
94
89
95
```output
90
96
New Supported Version List
91
97
----------------------
92
-
1.17.*9*, 1.17.*8*, 1.16.*11*, 1.16.*10*
98
+
1.29.*9*, 1.29.*8*, 1.28.*11*, 1.28.*10*
93
99
```
94
100
95
101
### Supported `kubectl` versions
96
102
97
103
You can use one minor version older or newer of `kubectl` relative to your **kube-apiserver** version, consistent with the [Kubernetes support policy for kubectl](https://kubernetes.io/docs/setup/release/version-skew-policy/#kubectl).
98
104
99
105
For example, if your **kube-apiserver** is at 1.17, then you can use versions 1.16 to 1.18 of `kubectl` with that **kube-apiserver**.
100
-
101
-
To install or update your version of `kubectl`, run `az AKS on Azure Local and Windows Server install-cli`.
106
+
To install or update your version of `kubectl`, run `az aks install-cli`.
102
107
103
108
## Release and deprecation process
104
109
@@ -123,20 +128,18 @@ Specific patch releases may be skipped or rollout accelerated, depending on the
123
128
124
129
### How does Microsoft notify me of new Kubernetes versions?
125
130
126
-
The AKS team publishes pre-announcements with planned dates of new Kubernetes versions in our documentation on [GitHub](https://github.com/Azure/aksArc/releases).
131
+
The AKS team publishes pre-announcements with planned dates of new Kubernetes versions in AKS Arc documentation.
127
132
128
133
### How often should I expect to upgrade Kubernetes versions to stay in support?
129
134
130
135
Starting with Kubernetes 1.19, the [open source community expanded support to one year](https://kubernetes.io/blog/2020/08/31/kubernetes-1-19-feature-one-year-support/). AKS commits to enabling patches and support matching the upstream commitments. For Kubernetes clusters on 1.19 and greater, you'll be able to upgrade a minimum of once a year to stay on a supported version.
131
136
132
-
For versions on 1.18 or below, the window of support remains at 9 months, requiring an upgrade once every 9 months to stay on a supported version. Regularly test new versions and be prepared to upgrade to newer versions to capture the latest stable enhancements within Kubernetes.
133
-
134
137
### What happens when a user upgrades a Kubernetes cluster with a minor version that isn't supported?
135
138
136
139
If you're on the n-3 version or older, it means you're outside of support and are asked to upgrade. When your upgrade from version n-3 to n-2 succeeds, you're back within our support policies. For example:
137
140
138
-
* If the oldest supported Kubernetes version is 1.15.a and you are on 1.14.b or older, you're outside of support.
139
-
* When you successfully upgrade from 1.14.b to 1.15.a or greater, you're back within our support policies.
141
+
* If the oldest supported Kubernetes version is 1.27 and you are on 1.26 or older, you're outside of support.
142
+
* When you successfully upgrade from 1.26 to 1.27 or greater, you're back within our support policies.
140
143
141
144
Downgrades are not supported.
142
145
@@ -174,8 +177,8 @@ No. Once a version is deprecated/removed, you cannot create a cluster with that
174
177
175
178
### I am on a freshly deprecated version. Can I still add new node pools? Or do I have to upgrade?
176
179
177
-
No. You can't add node pools of the deprecated version to your cluster. You can add node pools of a new version. However, this might require you to update the control plane first.
180
+
No. You can't add node pools of the deprecated version to your cluster.
178
181
179
182
## Next steps
180
183
181
-
For information about how to upgrade your cluster, see [Update the Kubernetes version of AKS clusters](./upgrade.md).
184
+
For information about how to upgrade your cluster, see [Update the Kubernetes version of AKS clusters](./cluster-upgrade.md).
title: Troubleshoot no VM sizes listed on Azure portal
3
+
description: Learn how to troubleshoot no VM sizes listed on Azure portal when you create an AKS Arc cluster
4
+
ms.topic: troubleshooting
5
+
author: sethmanheim
6
+
ms.author: sethm
7
+
ms.date: 10/02/2024
8
+
ms.reviewer: sumsmith
9
+
10
+
---
11
+
12
+
# Troubleshoot no VM sizes listed on Azure portal when you create an AKS Arc cluster
13
+
14
+
When you try creating an AKS Arc cluster from Azure portal, you see that there are no VM sizes listed. This can happen if **skus/default** resource in Azure is not yet created, or was deleted for some reason. This scenario can happen in Azure Local releases 2408 or older, when the default resource was not created as a part of the Azure Local deployment.
0 commit comments