You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/aks/cluster-configuration.md
+6-4Lines changed: 6 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,11 +12,13 @@ As part of creating an AKS cluster, you may need to customize your cluster confi
12
12
13
13
## OS configuration
14
14
15
-
AKS supports Ubuntu 18.04 as the default node operating system (OS) in general availability (GA) for clusters.
15
+
AKS supports Ubuntu 22.04 as the only node operating system (OS) for clusters with Kubernetes 1.25 and higher. Ubuntu 18.04 can also be specified at nodepool creation for Kubernetes versions 1.24 and below.
16
+
17
+
AKS supports Windows Server 2022 as the default operating system (OS) for Windows node pools in clusters with Kubernetes 1.25 and higher. Windows Server 2019 can also be specified at nodepool creation for Kubernetes versions 1.32 and below. Windows Server 2019 is being retired after Kubernetes version 1.32 reaches end of life (EOL) and won't be supported in future releases. For more information about this retirement, see the [AKS release notes][aks-release-notes].
16
18
17
19
## Container runtime configuration
18
20
19
-
A container runtime is software that executes containers and manages container images on a node. The runtime helps abstract away sys-calls or operating system (OS) specific functionality to run containers on Linux or Windows. Linux node pools use `containerd`for node pools using Kubernetes version 1.19 and greater. On Windows Server 2019 node pools, `containerd` is generally available and the only container runtime option on Kubernetes 1.21 and greater. Docker is no longer supported as of September 2022. For more information about this deprecation, see the [AKS release notes][aks-release-notes].
21
+
A container runtime is software that executes containers and manages container images on a node. The runtime helps abstract away sys-calls or operating system (OS) specific functionality to run containers on Linux or Windows. For Linux node pools, `containerd`is used on Kubernetes version 1.19 and higher. For Windows Server 2019 and 2022 node pools, `containerd` is generally available and is the only runtime option on Kubernetes version 1.23 and higher. Docker is being retired and won't be supported as of May 2023. For more information about this retirement, see the [AKS release notes][aks-release-notes].
20
22
21
23
[`Containerd`](https://containerd.io/) is an [OCI](https://opencontainers.org/) (Open Container Initiative) compliant core container runtime that provides the minimum set of required functionality to execute containers and manage images on a node. `Containerd` was [donated](https://www.cncf.io/announcement/2017/03/29/containerd-joins-cloud-native-computing-foundation/) to the Cloud Native Compute Foundation (CNCF) in March of 2017. The current Moby (upstream Docker) version that AKS uses is built on top of `containerd`.
22
24
@@ -31,7 +33,7 @@ By using `containerd` for AKS nodes, pod startup latency improves and node resou
31
33
> [!IMPORTANT]
32
34
> Clusters with Linux node pools created on Kubernetes v1.19 or greater default to `containerd` for its container runtime. Clusters with node pools on a earlier supported Kubernetes versions receive Docker for their container runtime. Linux node pools will be updated to `containerd` once the node pool Kubernetes version is updated to a version that supports `containerd`.
33
35
>
34
-
> `containerd` with Windows Server 2019 node pools is generally available, and is the only container runtime option in Kubernetes 1.21 and higher. You can continue using Docker node pools and clusters on versions earlier than 1.23, but Docker is no longer supported as of September 2022. For more information, see [Add a Windows Server node pool with `containerd`][aks-add-np-containerd].
36
+
> `containerd` with Windows Server 2019 and 2022 node pools is generally available, and is the only container runtime option in Kubernetes 1.23 and higher. You can continue using Docker node pools and clusters on versions earlier than 1.23, but Docker is no longer supported as of May 2023. For more information, see [Add a Windows Server node pool with `containerd`][aks-add-np-containerd].
35
37
>
36
38
> It is highly recommended you test your workloads on AKS node pools with `containerd` before using clusters with a Kubernetes version that supports `containerd` for your node pools.
Generation 2 VMs use the new UEFI-based boot architecture rather than the BIOS-based architecture used by generation 1 VMs.
58
60
Only specific SKUs and sizes support Gen2 VMs. Check the [list of supported sizes](../virtual-machines/generation-2.md#generation-2-vm-sizes), to see if your SKU supports or requires Gen2.
59
61
60
-
Additionally not all VM images support Gen2, on AKS Gen2 VMs use the new [AKS Ubuntu 18.04 image](#os-configuration). This image supports all Gen2 SKUs and sizes.
62
+
Additionally, not all VM images support Gen2 VMs. On AKS, Gen2 VMs use [AKS Ubuntu 22.04 or 18.04 image](#os-configuration) or [AKS Windows Server 2022 image](#os-configuration). These images support all Gen2 SKUs and sizes.
Copy file name to clipboardExpand all lines: articles/aks/learn/quick-windows-container-deploy-cli.md
+7-4Lines changed: 7 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -128,7 +128,7 @@ After a few minutes, the command completes and returns JSON-formatted informatio
128
128
## Add a Windows node pool
129
129
By default, an AKS cluster is created with a node pool that can run Linux containers. Use the `az aks nodepool add` command to add an additional node pool that can run Windows Server containers alongside the Linux node pool.
130
130
131
-
AKS supports Windows Server 2019 and Windows Server 2022 node pools. For Kubernetes versions "1.25.0" and higher, Windows Server 2022 is the default operating system. For earlier versions, Windows Server 2019 will be the default operating system.
131
+
AKS supports Windows Server 2019 and Windows Server 2022 node pools. For Kubernetes 1.25 and higher, Windows Server 2022 is the default operating system and only option in Kubernetes 1.33 and higher. For earlier versions, Windows Server 2019 will be the default operating system.
132
132
133
133
Use the `az aks nodepool add` command to add a Windows nodepool:
134
134
@@ -146,7 +146,10 @@ The above command creates a new node pool named *npwin* and adds it to the *myAK
146
146
147
147
## Add a Windows Server 2019 node pool
148
148
149
-
When creating a Windows node pool, the default operating system will be Windows Server 2019 for Kubernetes versions below "1.25.0". To use Windows Server 2019 nodes when not default, you will need to specify an OS SKU type of `Windows2019`.
149
+
> [!NOTE]
150
+
> Windows Server 2019 is being retired after Kubernetes version 1.32 reaches end of life (EOL) and won't be supported in future releases. For more information about this retirement, see the [AKS release notes][aks-release-notes].
151
+
152
+
When creating a Windows node pool, on Kubernetes version 1.24 or earlier, the default operating system will be Windows Server 2019. To use Windows Server 2019 node pools when not the default option, you need to specify an OS SKU type of `Windows2019`.
150
153
151
154
```azurecli-interactive
152
155
az aks nodepool add \
@@ -162,7 +165,7 @@ The above command creates a new Windows Server 2019 node pool named *npwin* and
162
165
163
166
## Add a Windows Server 2022 node pool
164
167
165
-
When creating a Windows node pool, the default operating system will be Windows Server 2022 for Kubernetes versions "1.25.0" and higher. To use Windows Server 2022 nodes when not default, you will need to specify an OS SKU type of `Windows2022`.
168
+
When creating a Windows node pool, for Kubernetes 1.25 and higher the default operating system will be Windows Server 2022. To use Windows Server 2022 nodes when not default, you need to specify an OS SKU type of `Windows2022`.
166
169
167
170
> [!NOTE]
168
171
> Windows Server 2022 requires Kubernetes version "1.23.0" or higher.
@@ -181,7 +184,7 @@ az aks nodepool add \
181
184
182
185
## Optional: Using `containerd` with Windows Server node pools
183
186
184
-
Beginning in Kubernetes version 1.20 and greater, you can specify `containerd` as the container runtime for Windows Server 2019 node pools. From Kubernetes 1.23, containerd will be the default container runtime for Windows.
187
+
Beginning in Kubernetes version 1.20 and higher, you can specify `containerd` as the container runtime for Windows Server 2019 node pools. Starting with Kubernetes 1.23, `containerd` is the default and only container runtime for Windows.
185
188
186
189
> [!IMPORTANT]
187
190
> When using `containerd` with Windows Server 2019 node pools:
Copy file name to clipboardExpand all lines: articles/aks/learn/quick-windows-container-deploy-powershell.md
+3Lines changed: 3 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -54,6 +54,9 @@ The following additional limitations apply to Windows Server node pools:
54
54
* The AKS cluster can have a maximum of 100 nodes in each node pool.
55
55
* The Windows Server node pool name has a limit of 6 characters.
56
56
57
+
> [!NOTE]
58
+
> Windows Server 2019 is being retired after Kubernetes version 1.32 reaches end of life (EOL) and won't be supported in future releases. For more information about this retirement, see the [AKS release notes][aks-release-notes].
59
+
57
60
## Create a resource group
58
61
59
62
An [Azure resource group](../../azure-resource-manager/management/overview.md)
Copy file name to clipboardExpand all lines: articles/aks/upgrade-windows-2019-2022.md
+14-11Lines changed: 14 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,11 +9,14 @@ ms.author: viniap
9
9
10
10
# Upgrade Kubernetes workloads from Windows Server 2019 to 2022
11
11
12
-
Upgrading the OS version of a running Windows workload on Azure Kubernetes Service (AKS) requires you to deploy a new node pool as Windows versions must match on each node pool. This article describes the steps to upgrade the OS version for Windows workloads as well as other important aspects.
12
+
Upgrading the OS version of a running Windows workload on Azure Kubernetes Service (AKS) requires you to deploy a new node pool as Windows versions must match on each node pool. This article describes the steps to upgrade the OS version for Windows workloads and other important aspects.
13
+
14
+
> [!NOTE]
15
+
> Windows Server 2019 is being retired after Kubernetes version 1.32 reaches end of life (EOL) and won't be supported in future releases. For more information about this retirement, see the [AKS release notes][aks-release-notes].
13
16
14
17
## Limitations
15
18
16
-
Windows Server 2019 and Windows Server 2022 cannot co-exist on the same node pool on AKS. A new node pool must be created to host the new OS version. It's important that you match the permissions and access of the previous node pool to the new one.
19
+
Windows Server 2019 and Windows Server 2022 can't co-exist on the same node pool on AKS. A new node pool must be created to host the new OS version. It's important that you match the permissions and access of the previous node pool to the new one.
17
20
18
21
## Before you begin
19
22
@@ -27,7 +30,7 @@ Windows Server 2019 and Windows Server 2022 cannot co-exist on the same node poo
27
30
28
31
## Add a Windows Server 2022 node pool to the existing cluster
29
32
30
-
Windows Server 2019 and 2022 cannot co-exist on the same node pool on AKS. To upgrade your application, you need a separate node pool for Windows Server 2022.
33
+
Windows Server 2019 and 2022 can't co-exist on the same node pool on AKS. To upgrade your application, you need a separate node pool for Windows Server 2022.
31
34
For more information on how to add a new Windows Server 2022 node pool to an existing AKS cluster, see [Add a Windows Server 2022 node pool](./learn/quick-windows-container-deploy-cli.md).
32
35
33
36
## Update your YAML file
@@ -39,7 +42,7 @@ Node Selector is the most common and recommended option for placement of Windows
39
42
"kubernetes.io/os": windows
40
43
```
41
44
42
-
The above annotation will find *any* Windows node available and place the pod on that node (of course, following all other scheduling rules). When upgrading from Windows Server 2019 to Windows Server 2022, you need to enforce not only the placement on a Windows node, but also on a node that is running the latest OS version. To accomplish this, one option is to use a different annotation:
45
+
The above annotation finds *any* Windows node available and places the pod on that node (following all other scheduling rules). When upgrading from Windows Server 2019 to Windows Server 2022, you need to enforce not only the placement on a Windows node, but also on a node that is running the latest OS version. To accomplish this, one option is to use a different annotation:
43
46
44
47
```yaml
45
48
nodeSelector:
@@ -49,16 +52,16 @@ The above annotation will find *any* Windows node available and place the pod on
49
52
Once you update the nodeSelector on the YAML file, you should also update the container image to be used. You can get this information from the previous step on which you created a new version of the containerized application by changing the FROM statement on your dockerfile.
50
53
51
54
> [!NOTE]
52
-
> You should leverage the same YAML file you used to deploy the application in the first place - this will ensure no other configuration is changed, only the nodeSelector and the image to be used.
55
+
> You should leverage the same YAML file you used to deploy the application in the first place - this ensures no other configuration is changed, only the nodeSelector and the image to be used.
53
56
54
57
## Apply the new YAML file to the existing workload
55
58
56
-
If you have an application deployed already, ensure you follow the steps recommended above to deploy a new node pool with Windows Server 2022 nodes. Once deployed, your environment will show Windows Server 2019 and 2022 nodes, with the workloads running on the 2019 nodes:
59
+
If you have an application deployed already, follow the recommended steps to deploy a new node pool with Windows Server 2022 nodes. Once deployed, your environment will show Windows Server 2019 and 2022 nodes, with the workloads running on the 2019 nodes:
57
60
58
61
```console
59
62
kubectl get nodes -o wide
60
63
```
61
-
The command above will show all nodes on your AKS cluster with additional details on the output:
64
+
This command shows all nodes on your AKS cluster with extra details on the output:
62
65
63
66
```output
64
67
NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
@@ -77,18 +80,18 @@ With the Windows Server 2022 node pool deployed and the YAML file configured, yo
77
80
kubectl apply -f <filename>
78
81
```
79
82
80
-
The command above should return a "configured" status for the deployment:
83
+
This command should return a "configured" status for the deployment:
81
84
82
85
```output
83
86
deployment.apps/sample configured
84
87
service/sample unchanged
85
88
```
86
-
At this point, AKS will start the process of terminating the existing pods and deploying new pods to the Windows Server 2022 nodes. You can check the status of your deployment by running:
89
+
At this point, AKS starts the process of terminating the existing pods and deploying new pods to the Windows Server 2022 nodes. You can check the status of your deployment by running:
87
90
88
91
```console
89
92
kubectl get pods -o wide
90
93
```
91
-
The command above return the status of the pods on the default namespace. You might need to change the command above to list the pods on specific namespaces.
94
+
This command returns the status of the pods on the default namespace. You might need to change the command above to list the pods on specific namespaces.
92
95
93
96
```output
94
97
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
## Active Directory, gMSA and Managed Identity implications
101
104
102
-
If you are leveraging Group Managed Service Accounts (gMSA) you will need to update the Managed Identity configuration for the new node pool. gMSA uses a secret (user account and password) so the node on which the Windows pod is running can authenticate the container against Active Directory. To access that secret on Azure Key Vault, the node uses a Managed Identity that allows the node to access the resource. Since Managed Identities are configured per node pool, and the pod now resides on a new node pool, you need to update that configuration. Check out [Enable Group Managed Service Accounts (GMSA) for your Windows Server nodes on your Azure Kubernetes Service (AKS) cluster](./use-group-managed-service-accounts.md) for more information.
105
+
If you're using Group Managed Service Accounts (gMSA), update the Managed Identity configuration for the new node pool. gMSA uses a secret (user account and password) so the node on which the Windows pod is running can authenticate the container against Active Directory. To access that secret on Azure Key Vault, the node uses a Managed Identity that allows the node to access the resource. Since Managed Identities are configured per node pool, and the pod now resides on a new node pool, you need to update that configuration. Check out [Enable Group Managed Service Accounts (GMSA) for your Windows Server nodes on your Azure Kubernetes Service (AKS) cluster](./use-group-managed-service-accounts.md) for more information.
103
106
104
107
The same principle applies to Managed Identities used for any other pod/node pool when accessing other Azure resources. Any access provided via Managed Identity needs to be updated to reflect the new node pool. To view update and sign-in activities, see [How to view Managed Identity activity](../active-directory/managed-identities-azure-resources/how-to-view-managed-identity-activity.md).
Copy file name to clipboardExpand all lines: articles/aks/use-windows-hpc.md
+6-7Lines changed: 6 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,34 +18,33 @@ A privileged DaemonSet can carry out changes or monitor a Linux host on Kubernet
18
18
19
19
* HostProcess containers require Kubernetes 1.23 or greater.
20
20
* HostProcess containers require `containerd` 1.6 or higher container runtime.
21
-
* HostProcess pods can only contain HostProcess containers. This is a current limitation of the Windows operating system. Non-privileged Windows containers can't share a vNIC with the host IP namespace.
21
+
* HostProcess pods can only contain HostProcess containers due to a limitation on the Windows operating system. Non-privileged Windows containers can't share a vNIC with the host IP namespace.
22
22
* HostProcess containers run as a process on the host. The only isolation those containers have from the host is the resource constraints imposed on the HostProcess user account.
23
23
* Filesystem isolation and Hyper-V isolation aren't supported for HostProcess containers.
24
24
* Volume mounts are supported and are mounted under the container volume. See Volume Mounts.
25
25
* A limited set of host user accounts are available for Host Process containers by default. See Choosing a User Account.
26
26
* Resource limits such as disk, memory, and cpu count, work the same way as fashion as processes on the host.
27
-
* Named pipe mounts and Unix domain sockets are not directly supported, but can be accessed on their host path, for example `\\.\pipe\*`.
27
+
* Named pipe mounts and Unix domain sockets aren't directly supported, but can be accessed on their host path, for example `\\.\pipe\*`.
28
28
29
29
30
30
## Run a HostProcess workload
31
31
32
-
To use HostProcess features with your deployment, set *privilaged: true*, *hostProcess: true*, and *hostNetwork: true*:
32
+
To use HostProcess features with your deployment, set *hostProcess: true* and *hostNetwork: true*:
33
33
34
34
```yaml
35
35
spec:
36
36
...
37
37
containers:
38
38
...
39
39
securityContext:
40
-
privileged: true
41
40
windowsOptions:
42
41
hostProcess: true
43
42
...
44
43
hostNetwork: true
45
44
...
46
45
```
47
46
48
-
To run an example workload that uses HostProcess features on an existing AKS cluster with Windows nodes, create `hostprocess.yaml` with the following:
47
+
To run an example workload that uses HostProcess features on an existing AKS cluster with Windows nodes, create `hostprocess.yaml` with the following contents:
You can verify your workload use the features of HostProcess by view the pod's logs.
99
+
Verify that your workload uses the features of HostProcess containers by viewing the pod's logs.
101
100
102
101
Use `kubectl` to find the name of the pod in the `kube-system` namespace.
103
102
@@ -119,7 +118,7 @@ Process has admin rights:
119
118
120
119
## Next steps
121
120
122
-
For more details on HostProcess containers and Microsoft's contribution to Kubernetes upstream, see the [Alpha in v1.22: Windows HostProcess Containers][blog-post].
121
+
For more information on HostProcess containers and Microsoft's contribution to Kubernetes upstream, see the [Alpha in v1.22: Windows HostProcess Containers][blog-post].
0 commit comments