You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: AKS-Arc/aks-on-azure-local-support-policy.md
+28-27Lines changed: 28 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -15,13 +15,13 @@ This article provides details about technical support policies and limitations f
15
15
16
16
## Service updates and releases
17
17
18
-
AKS on Azure Local adheres to the Kubernetes support calendar and releases Kubernetes versions to ensure AKS on Azure Local customers can always operate on a supported version of Kubernetes.
18
+
AKS on Azure Local adheres to the Kubernetes support calendar and releases Kubernetes versions to ensure that AKS on Azure Local customers can always operate on a supported version of Kubernetes.
19
19
20
20
A Kubernetes cluster that operates on a deprecated minor version must be updated to a supported version to be eligible for support. Once a minor version is deprecated, any Kubernetes clusters still running on this version continue to function. You can still perform operations such as scaling up or down.
21
21
22
-
Once a minor version is deprecated, it's removed from the Microsoft servers. At that point, Kubernetes clusters using this version are unable to update Kubernetes or OS versions and must be upgraded to the latest release. In some cases, this upgrade can also mean full re-deployment if the system is not in a healthy state.
22
+
Once a minor version is deprecated, it's removed from the Microsoft servers. At that point, Kubernetes clusters using this version are unable to update Kubernetes or OS versions and must be upgraded to the latest release. In some cases, this upgrade can also mean full redeployment if the system is not in a healthy state.
23
23
24
-
For release information, see the [AKS on Azure Local release notes.](/azure/aks/aksarc/aks-whats-new-23h2)
24
+
For release information, see the [AKS on Azure Local release notes](/azure/aks/aksarc/aks-whats-new-23h2).
25
25
26
26
## Managed features in AKS Arc
27
27
@@ -31,37 +31,36 @@ By contrast, AKS Arc provides a turnkey Kubernetes deployment that gives you the
31
31
32
32
Microsoft maintains the following components through the Arc Resource Bridge and the associated virtual machine base images for AKS Arc clusters:
33
33
34
-
- kubelet or Kubernetes API servers.
35
-
- etcd or a compatible key-value store, providing Quality of Service (QoS), scalability, and runtime.
36
-
- DNS services (for example, kube-dns or CoreDNS).
34
+
-**kubelet** or Kubernetes API servers.
35
+
-**etcd** or a compatible key-value store, providing Quality of Service (QoS), scalability, and runtime.
36
+
- DNS services (for example, **kube-dns** or CoreDNS).
37
37
- Kubernetes proxy or networking.
38
38
- Any other add-on or system component running in the kube-system namespace.
39
39
40
40
AKS Arc isn't a Platform-as-a-Service (PaaS) solution, and AKS clusters on Azure Local have shared responsibility. Users must help maintain the Kubernetes cluster. User input is required, for example, to apply an operating system (OS) security patch or update to a newer Kubernetes version.
41
41
42
-
The services are *managed* in the sense that Microsoft and the AKS team provide the tooling that deploys the Kubernetes components such as control plane nodes and nodepools for the AKS Arc clusters. Microsoft limits customization to ensure a consistent and scalable user experience.
42
+
The services are *managed* in the sense that Microsoft and the AKS team provide the tooling that deploys the Kubernetes components such as control plane nodes and nodepools for AKS Arc clusters. Microsoft limits customization to ensure a consistent and scalable user experience.
43
43
44
44
## Supported version policy
45
45
46
46
Kubernetes versions in AKS Arc follow the [Kubernetes version policy](https://kubernetes.io/releases/version-skew-policy/).
47
47
48
48
AKS Arc doesn't make any runtime (or other) guarantees for clusters outside of the supported versions list. "Outside of support" means that:
49
49
50
-
Your cluster operates on a deprecated minor version. The version you're running is outside of the supported versions list.
50
+
- Your cluster operates on a deprecated minor version. The version you're running is outside of the supported versions list.
51
+
- You are asked to upgrade the cluster to a supported version when you request support.
51
52
52
-
You are asked to upgrade the cluster to a supported version when requesting support.
53
-
54
-
For information about the supported Kubernetes versions, see [Supported Kubernetes versions](supported-kubernetes-versions.md).
53
+
For information about supported Kubernetes versions, see [Supported Kubernetes versions](supported-kubernetes-versions.md).
55
54
56
55
AKS Arc follows the platform version support timeframes for those products. That is, AKS Arc is not supported on unsupported versions of those products. For more information, see [Azure Local supported versions information](/azure/azure-local/release-information-23h2).
57
56
58
57
## Shared responsibility
59
58
60
59
When an AKS Arc cluster is created, you define the Kubernetes node pools that AKS Arc creates. Your workloads are executed on these node pools.
61
60
62
-
Because your node pools execute private code and store sensitive data, Microsoft Support has limited access to them. Microsoft Support can't sign in to execute commands on, or view logs for these nodes without your express permission or assistance. Any direct modification of the agent nodes by using any of the IaaS APIs renders the cluster unsupportable. Any modification done to the node pools must be done using Kubernetes-native mechanisms such as Daemon Sets.
61
+
Because your node pools execute private code and store sensitive data, Microsoft Support has limited access to them. Microsoft Support can't sign in to execute commands on, or view logs for these nodes without your express permission or assistance. Any direct modification of the agent nodes by using any of the IaaS APIs renders the cluster unsupportable. Any modification done to the node pools must be done using Kubernetes-native mechanisms such as **Daemon Sets**.
63
62
64
-
Similarly, while you can add any metadata, such as tags and labels, to the AKS Arc cluster and nodes, changing any of the system-created metadata renders the AKS Arc cluster unsupported.
63
+
Similarly, while you can add any metadata, such as tags and labels to the AKS Arc cluster and nodes, changing any of the system-created metadata renders the AKS Arc cluster unsupported.
65
64
66
65
## AKS Arc support coverage
67
66
@@ -72,7 +71,7 @@ Microsoft provides technical support for the following features and components:
72
71
- Etcd data store.
73
72
- Integration with Azure Arc and Arc enabled Kubernetes extensions.
74
73
- Questions or issues about customization of control plane components such as the Kubernetes API server, etcd, and coreDNS.
75
-
- Issues with networking, network access, and functionality. Issues could include DNS resolution, packet loss, and routing.
74
+
- Issues with networking, network access, and functionality. Issues can include DNS resolution, packet loss, and routing.
76
75
77
76
Microsoft supports various networking scenarios:
78
77
@@ -81,25 +80,27 @@ Microsoft supports various networking scenarios:
81
80
- Network performance and latency.
82
81
83
82
> [!NOTE]
84
-
> Any cluster actions taken by Microsoft AKS Arc support teams are made with user consent and assistance. Microsoft Support doesn't log into your AKS Arc cluster unless you configure access for the support engineer.
83
+
> Any cluster actions taken by Microsoft AKS Arc support teams are made with user consent and assistance. Microsoft Support doesn't log in to your AKS Arc cluster unless you configure access for the support engineer.
85
84
86
85
Microsoft doesn't provide technical support for questions about how to use Kubernetes. For example, Microsoft Support doesn't provide advice on:
87
86
88
-
- How to create custom ingress controllers
89
-
-Use application workloads
90
-
-Apply third-party or open-source software packages or tools.
87
+
- How to create custom ingress controllers.
88
+
-How to use application workloads.
89
+
-How to apply third-party or open-source software packages or tools.
91
90
- Third-party open-source projects that aren't provided as part of the Kubernetes control plane or deployed when AKS Arc clusters are created. These projects might include Istio, Helm, Envoy, or others.
92
91
- Third-party closed-source software. This software can include security scanning tools and networking devices or software.
93
92
- Network customizations other than the ones listed in the [AKS Arc documentation](aks-hci-network-system-requirements.md).
94
93
95
94
> [!NOTE]
96
-
> Microsoft Support can advise on cluster functionality, customization, and tuning in AKS Arc, for example, Kubernetes operations issues and procedures.
95
+
> Microsoft Support can advise on cluster functionality, customization, and tuning in AKS Arc; for example, Kubernetes operations issues and procedures.
97
96
98
97
> [!NOTE]
99
98
> Microsoft can provide best-effort support for third-party open-source projects such as Helm. Where the third-party open-source tool integrates with Kubernetes or other AKS Arc-specific bugs, Microsoft supports examples and applications from Microsoft documentation.
100
99
101
100
## AKS Arc support coverage for node pools
102
101
102
+
This section describes the support coverage for AKS Arc node pools. Node pools are the Kubernetes agent nodes that run your workloads.
103
+
103
104
### Microsoft responsibilities for AKS Arc node pools
104
105
105
106
Microsoft and users share responsibility for Kubernetes agent nodes where:
@@ -116,12 +117,12 @@ Microsoft and users share responsibility for Kubernetes agent nodes where:
116
117
117
118
### Customer responsibilities for AKS Arc node pools
118
119
119
-
AKS Arc regularly releases new Kubernetes patches and minor versions. These updates can contain security or functionality improvements to Kubernetes. You're responsible for keeping your cluster's Kubernetes version and therefore node pool versions are updated according to the [AKS Arc supported versions policy.](/azure/aks/aksarc/aks-whats-new-23h2)
120
+
AKS Arc regularly releases new Kubernetes patches and minor versions. These updates can contain security or functionality improvements to Kubernetes. You're responsible for keeping your cluster's Kubernetes version and node pool versions updated according to the [AKS Arc supported versions policy](/azure/aks/aksarc/aks-whats-new-23h2).
120
121
121
122
### User customization of node pools
122
123
123
124
> [!NOTE]
124
-
> AKS Arc agent nodes appear in Hyper-V as regular virtual machine resources. These virtual machines are deployed with a custom OS image, and supported and managed Kubernetes components. You cannot change the base OS image or do any direct customizations to these nodes using the Hyper-V APIs or resources. Any custom changes that are not done via the AKS Arc API do not persist through an upgrade, scale, update, or reboot, and can render the Kubernetes cluster unsupported. Avoid performing changes to the agent nodes unless Microsoft Support directs you to make changes.
125
+
> AKS Arc agent nodes appear in Hyper-V as regular virtual machine resources. These virtual machines are deployed with a custom OS image, and supported and managed Kubernetes components. You can't change the base OS image or do any direct customizations to these nodes using the Hyper-V APIs or resources. Any custom changes that are not done via the AKS Arc API do not persist through an upgrade, scale, update, or reboot, and can render the Kubernetes cluster unsupported. Avoid performing changes to the agent nodes unless Microsoft Support directs you to make changes.
125
126
126
127
AKS Arc manages the lifecycle and operations of node pool images on your behalf. Modifying the resources associated with the node pools is not supported. For example, customizing a virtual machine's network settings by manually changing configurations through the Hyper-V API or tools is not supported.
127
128
@@ -149,11 +150,11 @@ Clusters that are stopped for more than 30 days can no longer be updated. The co
149
150
150
151
## Deleted or suspended subscription
151
152
152
-
If your Azure subscription is suspended or deleted, your AKS cluster(s) are out of support after 60 days, unless the subscription is reinstated before the 60-day limit is reached. All other limitations described previously also apply. Once the subscription is deleted, the cluster connection to Azure cannot be recovered and Azure Local and AKS Arc must be re-deployed.
153
+
If your Azure subscription is suspended or deleted, your AKS cluster(s) are out of support after 60 days, unless the subscription is reinstated before the 60-day limit is reached. All other limitations described previously also apply. Once the subscription is deleted, the cluster connection to Azure cannot be recovered and Azure Local and AKS Arc must be redeployed.
153
154
154
155
## Unsupported preview and beta Kubernetes features
155
156
156
-
AKS Arc only supports stable and beta features in the upstream Kubernetes project. Unless otherwise documented, AKS Arc doesn't support any preview feature that is available in the upstream Kubernetes project.
157
+
AKS Arc only supports stable and beta features in the upstream Kubernetes project. Unless otherwise documented, AKS Arc doesn't support any preview feature that's available in the upstream Kubernetes project.
157
158
158
159
## Preview features or feature flags
159
160
@@ -163,12 +164,12 @@ Features in public preview receive "best effort" support, as these features are
163
164
164
165
## Upstream bugs and issues
165
166
166
-
Given the speed of development in the upstream Kubernetes project, bugs invariably arise. Some of these bugs can't be patched or worked around within the AKS Arc system. Instead, bug fixes require larger patches to upstream projects (such as Kubernetes, node or agent operating systems, and kernel). For components that Microsoft owns (such as the cluster API providers for Azure Local), AKS Arc and Azure personnel are committed to fixing issues upstream in the community.
167
+
Given the speed of development in the upstream Kubernetes project, bugs invariably occur. Some of these bugs can't be patched or worked around within the AKS Arc system. Instead, bug fixes require larger patches to upstream projects (such as Kubernetes, node or agent operating systems, and kernel). For components that Microsoft owns (such as the cluster API providers for Azure Local), AKS Arc and Azure personnel are committed to fixing issues upstream in the community.
167
168
168
-
When a technical support issue is root-caused by one or more upstream bugs, AKS Arc support and engineering teams will do the following:
169
+
When a technical support issue is caused by one or more upstream bugs, AKS Arc support and engineering teams do the following:
169
170
170
-
- Identify and link the upstream bugs with any supporting details to help explain why this issue affects your cluster or workload. Customers receive links to the required repositories, so they can watch the issues and see when a new release will provide fixes.
171
-
- Provide potential workarounds or mitigation. If the issue can be mitigated, a [known issue is filed in the AKS on Azure Local and Windows Server repository](https://github.com/Azure/aksArc/issues?q=is%3Aopen+is%3Aissue+label%3Aknown-issue). The known-issue filing explains:
171
+
- Identify and link the upstream bugs with any supporting details to help explain why this issue affects your cluster or workload. Customers receive links to the required repositories, so they can watch the issues and see when a new release provides fixes.
172
+
- Provide potential workarounds or mitigation. If the issue can be mitigated, a [known issue is filed in the AKS on Azure Local and Windows Server repository](https://github.com/Azure/aksArc/issues?q=is%3Aopen+is%3Aissue+label%3Aknown-issue). The knownissue filing explains:
172
173
- The issue, including links to upstream bugs.
173
174
- The workaround and details about an upgrade or another option for the solution.
174
175
- Rough timelines for the issue's inclusion, based on the upstream release cadence.
0 commit comments