Skip to content

Commit 5ceb49f

Browse files
authored
Merge pull request #16427 from sethmanheim/aa-contribkubver
Pull PR Update supported-kubernetes-versions
2 parents 252447c + c56f285 commit 5ceb49f

8 files changed

+171
-129
lines changed

.openpublishing.redirection.aks.json

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1405,6 +1405,11 @@
14051405
"redirect_url": "/azure/aks/hybrid/concepts-security",
14061406
"redirect_document_id": false
14071407
},
1408+
{
1409+
"source_path": "AKS-Hybrid/webhook-denied-request.md",
1410+
"redirect_url": "/azure/aks/hybrid/troubleshoot-overview",
1411+
"redirect_document_id": false
1412+
},
14081413
{
14091414
"source_path": "AKS-Hybrid/create-storage-classes.md",
14101415
"redirect_url": "/azure/aks/hybrid/overview",

AKS-Hybrid/TOC.yml

Lines changed: 7 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@
2424
items:
2525
- name: Networking concepts and requirements
2626
href: aks-hci-network-system-requirements.md
27-
- name: IP address planning for Kubernetes
27+
- name: IP address planning
2828
href: aks-hci-ip-address-planning.md
2929
- name: Load balancer
3030
href: load-balancer-overview.md
@@ -142,22 +142,20 @@
142142
href: get-on-demand-logs.md
143143
- name: Troubleshooting
144144
items:
145-
- name: Known issues
146-
href: aks-known-issues.md
147-
- name: Troubleshoot
145+
- name: Troubleshoot & known issues
148146
href: aks-troubleshoot.md
147+
- name: K8sVersionValidation error
148+
href: cluster-k8s-version.md
149149
- name: Use diagnostic checker
150150
href: aks-arc-diagnostic-checker.md
151151
- name: KubeAPIServer unreachable error
152152
href: kube-api-server-unreachable.md
153-
- name: No K8s versions or VM sizes listed for cluster creation
154-
href: cluster-k8s-version.md
155-
- name: Deleted cluster still visible in portal
153+
- name: Can't see VM SKUs on Azure portal
154+
href: tsg-check-vm-sku.md
155+
- name: Deleted AKS Arc cluster still visible on Azure portal
156156
href: deleted-cluster-visible.md
157157
- name: Can't fully delete AKS Arc cluster with PodDisruptionBudget (PDB) resources
158158
href: delete-cluster-pdb.md
159-
- name: Kubernetes version x.x.x is not available
160-
href: webhook-denied-request.md
161159
- name: Reference
162160
items:
163161
- name: Azure CLI

AKS-Hybrid/aks-hci-ip-address-planning.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
---
2-
title: IP address planning for AKS
3-
description: Learn about how to plan for IP addresses and reservation, to deploy AKS in production.
2+
title: IP address planning for AKS enabled by Azure Arc
3+
description: Learn about how to plan for IP addresses and reservation, to deploy AKS Arc in production.
44
ms.topic: conceptual
55
ms.date: 11/19/2024
66
author: sethmanheim
@@ -13,7 +13,7 @@ ms.lastreviewed: 10/08/2024
1313

1414
[!INCLUDE [hci-applies-to-23h2](includes/hci-applies-to-23h2.md)]
1515

16-
IP address planning for AKS involves designing a network that supports applications, node pools, pod networks, service communication, and external access. This article walks you through some key considerations for effective IP address planning, and minimum number of IP addresses required to deploy AKS in production. See the [AKS networking concepts and requirements](aks-hci-network-system-requirements.md) before reading this article.
16+
IP address planning for AKS enabled by Azure Arc involves designing a network that supports applications, node pools, pod networks, service communication, and external access. This article walks you through some key considerations for effective IP address planning, and minimum number of IP addresses required to deploy AKS in production. See the [AKS networking concepts and requirements](aks-hci-network-system-requirements.md) before reading this article.
1717

1818
## Simple IP address planning for Kubernetes clusters and applications
1919

@@ -102,6 +102,7 @@ AKS provides a **default value of 10.244.0.0/16** for the pod network CIDR. AKS
102102
### Service network CIDR
103103

104104
The Service network CIDR is the range of IP addresses reserved for Kubernetes services like LoadBalancers, ClusterIP, and NodePort within a cluster. Kubernetes supports the following service types:
105+
105106
- ClusterIP: The default service type, which exposes the service within the cluster. The IP assigned from the Service network CIDR is only accessible within the Kubernetes cluster.
106107
- NodePort: Exposes the service on a specific port on each node's IP address. The ClusterIP is still used internally, but external access is through the node IPs and a specific port.
107108
- LoadBalancer: This type creates a cloud-provider-managed load balancer and exposes the service externally. The cloud provider typically manages the external IP assignment, while the internal ClusterIP remains within the service network CIDR.

AKS-Hybrid/aks-troubleshoot.md

Lines changed: 5 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@ title: Troubleshoot common issues in AKS enabled by Azure Arc
33
description: Learn about common issues and workarounds in AKS enabled by Arc.
44
ms.topic: how-to
55
author: sethmanheim
6-
ms.date: 02/27/2024
6+
ms.date: 11/22/2024
77
ms.author: sethm
88
ms.lastreviewed: 02/27/2024
99
ms.reviewer: guanghu
@@ -16,7 +16,7 @@ This article describes how to find solutions for issues you encounter when using
1616

1717
## Open a support request
1818

19-
See the [Get support](/azure/aks/hybrid/help-support?tabs=aksee) article for information about how to use the Azure portal to get support or open a support request for AKS Edge Essentials.
19+
See the [Get support](/azure/aks/hybrid/help-support?tabs=aksee) article for information about how to use the Azure portal to get support or open a support request for AKS Arc.
2020

2121
## Upgrade
2222

@@ -25,8 +25,9 @@ See the [Get support](/azure/aks/hybrid/help-support?tabs=aksee) article for inf
2525
If you continually see an [Azure Advisor](/azure/advisor/) upgrade recommendation that says "Upgrade to the latest version of AKS enabled by Azure Arc," follow these steps to disable the recommendation:
2626

2727
- Ensure that you update your Azure Local solution to the latest version. For more information, see [About updates for Azure Local, version 23H2](/azure-stack/hci/update/about-updates-23h2).
28-
- If you use any of the Azure SDKs, ensure that you are using the latest version of that SDK. You can find the Azure SDKs by searching for "HybridContainerService" on the [Azure SDK releases](https://azure.github.io/azure-sdk/) page.
28+
- If you use any of the Azure SDKs, ensure that you're using the latest version of that SDK. You can find the Azure SDKs by searching for "HybridContainerService" on the [Azure SDK releases](https://azure.github.io/azure-sdk/) page.
2929

3030
## Next steps
3131

32-
- [AKS enabled by Azure Arc known issues](aks-known-issues.md)
32+
- [Troubleshoot K8sVersionValidation error](cluster-k8s-version.md)
33+
- [Use diagnostic checker](aks-arc-diagnostic-checker.md)

AKS-Hybrid/cluster-k8s-version.md

Lines changed: 68 additions & 13 deletions
Original file line numberDiff line numberDiff line change
@@ -1,35 +1,90 @@
11
---
2-
title: Troubleshoot no K8s versions or VM sizes listed when you create an AKS Arc cluster
3-
description: Learn how to troubleshoot no K8s versions or VM sizes listed when you create an AKS Arc cluster.
2+
title: Troubleshoot K8sVersionValidation error code
3+
description: Learn how to troubleshoot the K8sVersionValidation error code.
44
ms.topic: troubleshooting
55
author: sethmanheim
66
ms.author: sethm
7-
ms.date: 10/02/2024
8-
ms.reviewer: sumsmith
7+
ms.date: 11/22/2024
8+
ms.reviewer: abha
99

1010
---
1111

12-
# Troubleshoot no K8s versions or VM sizes listed when you create an AKS Arc cluster
12+
# Troubleshoot K8sVersionValidation error code
1313

14-
The **kubernetesVersions/default** or the **skus/default** resource in Azure is not yet created, or was deleted for some reason. This scenario can happen in older releases when the default resource was not created as a part of the deployment.
14+
This article describes how to identify and resolve the K8sVersionValidation error code that occurs when you try to create and deploy an AKS cluster on Azure Local.
1515

16-
## Workaround
16+
## Symptoms
1717

18-
Run the following command:
18+
When you try to create an AKS Arc cluster, you receive one of the following error messages:
19+
20+
- `Kubernetes version 1.27.7 is not ready for use on Linux. Please go to https://aka.ms/aksarccheckk8sversions for details of how to check the readiness of Kubernetes versions`
21+
- `Kubernetes version 1.26.12 is not supported. Please go to https://aka.ms/aksarcsupportedversions for details about the supported Kubernetes version on this platform.`
22+
- `Admission webhook \'vhybridakscluster.kb.io\' denied the request: Kubernetes version 1.26.12 is not available`
23+
24+
## Error messages
25+
26+
This section describes the error messages that you might see when you encounter the K8sVersionValidation error code.
27+
28+
### Kubernetes version 1.27.7 is not ready for use on Linux
29+
30+
This error message is caused by an incomplete Linux VHD download.
31+
32+
When you install Azure Local, you download a Linux VHD of approximately 4-5 GB in size. This Linux VHD is used to create the underlying VMs for the Kubernetes nodes in your AKS Arc cluster. The error message can occur when your Linux VHD didn't finish downloading. To resolve this issue, you should wait until your internet connection finishes downloading the Linux VHD image.
33+
34+
To check if the image download is in progress or finished, run the following command:
35+
36+
```azurecli
37+
$cl_id = "/subscriptions/<subscription_id>/resourceGroups/<resource_group_name>/providers/Microsoft.ExtendedLocation/customLocations/<custom_location_name>"
38+
39+
# Get the kubernetes version using CLI (it automatically creates the **kubernetesVersions/default** Azure resource).
40+
az aksarc get-versions --custom-location $cl_id
41+
```
42+
43+
If this command says that the K8s versions are ready, and you're running Azure Local [release 2411](/azure/aks/hybrid/aks-whats-new-23h2#release-2411) or newer, file a [support request](help-support.md).
44+
45+
If you're running Azure Local release 2408 or older, proceed to the next section. We strongly recommend that you upgrade your Azure Local deployment to the latest version, in order to get the latest bug fixes and security updates.
46+
47+
#### Recreate kubernetesVersions/default
48+
49+
If you redeploy Azure Local with the same name and parameters, you might have to recreate **kubernetesVersions/default**. To do so, run the following commands:
50+
51+
```azurecli
52+
$subscription = <subscription_id>
53+
$cl_id = <custom_location_id>
54+
55+
az login --use-device-code
56+
az account set -s $subscription
57+
$token = $(az account get-access-token --query accessToken)
58+
$url = "https://management.azure.com${cl_id}/providers/Microsoft.HybridContainerService/kubernetesVersions/default?api-version=2024-01-01"
59+
60+
# Get the Kubernetes version Azure resource
61+
az rest --headers "Authorization=Bearer $token" "Content-Type=application/json;charset=utf-8" --uri $url --method GET
62+
63+
# Delete the Kubernetes version Azure resource
64+
az rest --headers "Authorization=Bearer $token" "Content-Type=application/json;charset=utf-8" --uri $url --method DELETE
65+
66+
# Get the Kubernetes version using CLI (it automatically creates the Kubernetes version Azure resource)
67+
az aksarc get-versions --custom-location $cl_id
68+
```
69+
70+
#### Can't see the Kubernetes versions or VM size options on the Azure portal
71+
72+
This scenario can happen in Azure Local releases 2408 or older, when the default resource for Kubernetes version (or VM sizes) was not created as a part of the Azure Local deployment.
73+
74+
To resolve this issue, run the following command:
1975

2076
```azurecli
2177
$cl_id = "/subscriptions/<subscription_id>/resourceGroups/<resource_group_name>/providers/Microsoft.ExtendedLocation/customLocations/<custom_location_name>"
2278
23-
# Get the kubernetes version or the VM sizes using CLI (it automatically creates the **kubernetesVersions/default** or the **skus/default** azure resource).
79+
# Get the kubernetes version using CLI (it automatically creates the **kubernetesVersions/default** Azure resource).
2480
2581
az aksarc get-versions --custom-location $cl_id
26-
az aksarc vmsize list --custom-location $cl_id
2782
```
2883

29-
## Validation
84+
### Kubernetes version 1.26.12 is not supported
3085

31-
Verify that the portal displays the correct list of supported K8s versions and VM sizes. See [this list of supported K8s versions](aks-whats-new-23h2.md#release-2408) for each Azure Local release.
86+
Azure Local supports specific Kubernetes versions in each of its releases. As stated in the error message, go to `https://aka.ms/aksarcsupportedversions` for a list of supported Kubernetes versions based on your deployed Azure Local release.
3287

3388
## Next steps
3489

35-
[Known issues in AKS enabled by Azure Arc](aks-known-issues.md)
90+
[Troubleshoot issues in AKS enabled by Azure Arc](aks-troubleshoot.md)

0 commit comments

Comments
 (0)