You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/kubernetes-fleet/concepts-choosing-fleet.md
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,11 +14,11 @@ This article provides an overview of the various Azure Kubernetes Fleet Manager
14
14
15
15
## Fleet types
16
16
17
-
Kubernetes Fleet can be created with or without a hub cluster. Hub cluster is a managed Azure Kubernetes Service (AKS) cluster that acts as a hub to store and propagate Kubernetes resources.
17
+
A Kubernetes Fleet resource can be created with or without a hub cluster. A hub cluster is a managed Azure Kubernetes Service (AKS) cluster that acts as a hub to store and propagate Kubernetes resources.
18
18
19
-
The following table compares the scenarios enabled by the hub cluster.
19
+
The following table compares the scenarios enabled by the hub cluster:
20
20
21
-
| Capability | Kubernetes Fleet without hub cluster | Kubernetes Fleet with hub cluster |
21
+
| Capability | Kubernetes Fleet resource without hub cluster | Kubernetes Fleet resource with hub cluster |
|**Member cluster limit**|Up to 100 clusters|Up to 20 clusters|
@@ -30,21 +30,21 @@ The following table compares the scenarios enabled by the hub cluster.
30
30
31
31
## Kubernetes Fleet resource without hub clusters
32
32
33
-
Without a hub cluster, Fleet acts solely as a grouping entity in Azure Resource Manager. Certain scenarios, such as update runs, don't require a Kubernetes API and thus don't require a hub cluster. To take full advantage of all the features available, you need a Kubernetes Fleet resource with a hub cluster.
33
+
Without a hub cluster, Kubernetes Fleet acts solely as a grouping entity in Azure Resource Manager (ARM). Certain scenarios, such as update runs, don't require a Kubernetes API and thus don't require a hub cluster. To take full advantage of all the features available, you need a Kubernetes Fleet resource with a hub cluster.
34
34
35
-
For more information, see [Create a hubless fleet][create-fleet-without-hub].
35
+
For more information, see [Create a Kubernetes Fleet resource without a hub cluster][create-fleet-without-hub].
36
36
37
37
## Kubernetes Fleet resource with hub clusters
38
38
39
-
A Kubernetes Fleet resource with hub cluster has an associated AKS-managed cluster, which is used to store configuration for workload orchestration and layer-4 load balancing.
39
+
A Kubernetes Fleet resource with a hub cluster has an associated AKS-managed cluster, which is used to store the configuration for workload orchestration and layer-4 load balancing.
40
40
41
-
Upon the creation of a A Kubernetes Fleet resource with hub cluster, a hub AKS cluster is automatically created in the same subscription under a managed resource group named `FL_*`. To improve reliability, hub clusters are locked down by denying any userinitiated mutations to the corresponding AKS clusters (under the Fleet-managed resource group `FL_*`) and their underlying Azure resources (under the AKS-managed resource group `MC_FL_*`), such as VMs, via Azure deny assignments. Control plane operations, such as changing the hub cluster's configuration through Azure Resource Manager (ARM) or deleting the cluster entirely, are denied. Data plane operations, such as connecting to the hub cluster's Kubernetes API server in order to configure workload orchestration, are not denied.
41
+
Upon the creation of a Kubernetes Fleet resource with a hub cluster, a hub AKS cluster is automatically created in the same subscription under a managed resource group that begins with `FL_`. To improve reliability, hub clusters are locked down by denying any user-initiated mutations to the corresponding AKS clusters (under the Fleet-managed resource group `FL_`) and their underlying Azure resources (under the AKS-managed resource group `MC_FL_*`), such as virtual machines (VMs), via Azure deny assignments. Control plane operations, such as changing the hub cluster's configuration through Azure Resource Manager (ARM) or deleting the cluster entirely, are denied. Data plane operations, such as connecting to the hub cluster's Kubernetes API server in order to configure workload orchestration, are not denied.
42
42
43
43
Hub clusters are exempted from [Azure policies][azure-policy-overview] to avoid undesirable policy effects upon hub clusters.
44
44
45
45
### Network access modes for hub cluster
46
46
47
-
For Kubernetes Fleet resource with hub cluster, there are two network access modes:
47
+
For a Kubernetes Fleet resource with a hub cluster, there are two network access modes:
48
48
49
49
-**Public hub clusters** expose the hub cluster to the internet. This means that with the right credentials, anyone on the internet can connect to the hub cluster. This configuration can be useful during the development and testing phase, but represents a security concern, which is largely undesirable in production.
50
50
@@ -57,7 +57,7 @@ Some other details to consider:
57
57
- Whether you choose a public or private hub, the type can't be changed after creation.
58
58
- When using an AKS private cluster, you have the ability to configure fully qualified domain names (FQDNs) and FQDN subdomains. This functionality doesn't apply to the private hub cluster of the Kubernetes Fleet resource.
59
59
- When you connect to a private hub cluster, you can use the same methods that you would use to [connect to any private AKS cluster][aks-private-cluster-connect]. However, connecting using AKS command invoke and private endpoints aren't currently supported.
60
-
- When you use private hub clusters, you're required to specify the subnet in which the Fleet hub cluster's node VMs reside. This process differs slightly from the AKS private cluster equivalent. For more information, see [create a Kubernetes Fleet resource with a private hub cluster][create-private-hub-cluster].
60
+
- When you use private hub clusters, you're required to specify the subnet in which the Kubernetes Fleet hub cluster's node VMs reside. This process differs slightly from the AKS private cluster equivalent. For more information, see [create a Kubernetes Fleet resource with a private hub cluster][create-private-hub-cluster].
Copy file name to clipboardExpand all lines: articles/kubernetes-fleet/concepts-resource-propagation.md
+1-1Lines changed: 1 addition & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -64,7 +64,7 @@ For more information, see the [`ClusterResourcePlacement` API reference][cluster
64
64
65
65
When creating the `ClusterResourcePlacement`, the following affinity types can be specified:
66
66
67
-
-**requiredDuringSchedulingIgnoredDuringExecution**: As this affinity is of the required type during scheduling, it **filters** the clusters based on their properties
67
+
-**requiredDuringSchedulingIgnoredDuringExecution**: As this affinity is of the required type during scheduling, it **filters** the clusters based on their properties.
68
68
-**preferredDuringSchedulingIgnoredDuringExecution**: As this affinity is only of the preferred type, but is not required during scheduling, it provides preferential ranking to clusters based on properties specified by you such as cost or resource availability.
69
69
70
70
Multiple placement types are available for controlling the number of clusters to which the Kubernetes resource needs to be propagated:
Copy file name to clipboardExpand all lines: articles/kubernetes-fleet/concepts-update-orchestration.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -49,7 +49,7 @@ An update run can be in one of the following states:
49
49
-**NotStarted**: State of the update run before it is started.
50
50
-**Running**: Upgrade is in progress for at least one of the clusters in the update run.
51
51
-**Pending**:
52
-
-**Member cluster**: A member cluster can be in the pending state for any of the following reasons and are surfaced under the message field -
52
+
-**Member cluster**: A member cluster can be in the pending state for any of the following reasons and are surfaced under the message field.
53
53
- Maintenance window is not open. Message indicates next opening time.
54
54
- Target Kubernetes version is not yet available in the region of the member. Message links to the release tracker so that you can check status of the release across regions.
55
55
- Target node image version is not yet available in the region of the member. Message links to the release tracker so that you can check status of the release across regions.
@@ -64,7 +64,7 @@ An update run can be in one of the following states:
64
64
- When consistent node image is chosen for an upgrade run, if it's not possible to find the target image version for one of the node pools, then upgrade is skipped for that cluster. An example situation for this is when a new node pool with a new VM SKU is added after an update run has started.
65
65
-**Group**:
66
66
- All member clusters were detected as `Skipped` by the system.
67
-
- You initiated a skip at the group level
67
+
- You initiated a skip at the group level.
68
68
-**Stage**:
69
69
- All groups in the stage where detected as `Skipped` by the system.
Application developers often need to deploy Kubernetes resources into multiple clusters. Fleet operators often need to pick the best clusters for placing the workloads based on heuristics such as cost of compute in the clusters or available resources such as memory and CPU. It's tedious to create, update, and track these Kubernetes resources across multiple clusters manually. This article covers how Azure Kubernetes Fleet Manager (Kubernetes Fleet) allows you to address these scenarios using the intelligent Kubernetes resource placement feature.
14
14
15
15
## Overview
16
16
17
17
Kubernetes Fleet provides resource placement capability that can make scheduling decisions based on the following properties:
18
-
- Node count.
19
-
- Cost of compute in target member clusters.
20
-
- Resource (CPU/Memory) availability in target member clusters.
18
+
- Node count
19
+
- Cost of compute in target member clusters
20
+
- Resource (CPU/Memory) availability in target member clusters
`[CAPACITY-TYPE]` is one of `total`, `allocatable`, or `available`, depending on which capacity (usage information) you would like to check against, and `[RESOURCE-NAME]` is the name of the resource (CPU/memory).
44
+
`<CAPACITY-TYPE>` is one of `total`, `allocatable`, or `available`, depending on which capacity (usage information) you would like to check against, and `<RESOURCE-NAME>` is the name of the resource (CPU/memory).
45
45
46
46
For example, if you would like to select clusters based on the available CPU capacity of a cluster, the name used in the property selector should be `resources.kubernetes-fleet.io/available-cpu`. For allocatable memory capacity, you can use `resources.kubernetes-fleet.io/allocatable-memory`.
Copy file name to clipboardExpand all lines: articles/kubernetes-fleet/quickstart-create-fleet-and-members.md
+2-1Lines changed: 2 additions & 1 deletion
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -88,7 +88,8 @@ The following output example resembles successful creation of the resource group
88
88
You can create a Fleet resource to later group your AKS clusters as member clusters. When created via Azure CLI, by default, this resource enables member cluster grouping and update orchestration. If the Fleet hub is enabled, other preview features are enabled, such as Kubernetes object propagation to member clusters and L4 service load balancing across multiple member clusters. For more information, see the [conceptual overview of fleet types](./concepts-choosing-fleet.md), which provides a comparison of different fleet configurations.
89
89
90
90
> [!IMPORTANT]
91
-
> Once a Fleet resource has been created, it's possible to upgrade a Kubernetes Fleet resource without a hub cluster to one with a hub cluster. For Kubernetes Fleet resources with a hub cluster, once private or public has been selected it cannot be changed.
91
+
> Once a Kubernetes Fleet resource has been created, it's possible to upgrade a Kubernetes Fleet resource without a hub cluster to one with a hub cluster. For Kubernetes Fleet resources with a hub cluster, once private or public has been selected it cannot be changed.
92
+
92
93
93
94
### [Kubernetes Fleet resource without hub cluster](#tab/without-hub-cluster)
Copy file name to clipboardExpand all lines: articles/kubernetes-fleet/upgrade-hub-cluster-type.md
+10-10Lines changed: 10 additions & 10 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -11,7 +11,7 @@ ms.service: kubernetes-fleet
11
11
12
12
# Upgrade hub cluster type for Azure Kubernetes Fleet Manager resource
13
13
14
-
In this article, you learn how to upgrade an Azure Kubernetes Fleet Manager (Kubernetes Fleet) resource without any hub cluster to a Kubernetes Fleet resource having a hub cluster. When a Kubernetes Fleet resource is created without a hub cluster, a central Azure Kubernetes Service (AKS) cluster isn't created for the Kubernetes Fleet resource. When a Kubernetes Fleet resource with hub cluster is created, a central and managed AKS cluster is created to enable scenarios such as workload orchestration and layer-4 load balancing.
14
+
In this article, you learn how to upgrade an Azure Kubernetes Fleet Manager (Kubernetes Fleet) resource without a hub cluster to a Kubernetes Fleet resource that has a hub cluster. When a Kubernetes Fleet resource is created without a hub cluster, a central Azure Kubernetes Service (AKS) cluster isn't created for the Kubernetes Fleet resource. When a Kubernetes Fleet resource with a hub cluster is created, a central and managed AKS cluster is created to enable scenarios such as workload orchestration and layer-4 load balancing.
15
15
16
16
For more information, see [Choosing an Azure Kubernetes Fleet Manager option][concepts-choose-fleet].
17
17
@@ -20,14 +20,14 @@ For more information, see [Choosing an Azure Kubernetes Fleet Manager option][co
-[Install or upgrade Azure CLI](/cli/azure/install-azure-cli) to the latest version.
22
22
- An Azure account with an active subscription. [Create an account for free](https://azure.microsoft.com/free/?WT.mc_id=A261C142F).
23
-
- You must have an existing Kubernetes Fleet resource without the hub cluster. The steps in this article show you how to create such a Kubernetes Fleet resource without the hub cluster, but you already have one you can substitute your existing resource.
23
+
- You must have an existing Kubernetes Fleet resource without a hub cluster. The steps in this article show you how to create a Kubernetes Fleet resource without a hub cluster. If you already have one, you can skip the initial setup and begin at [Upgrade hub cluster type for the Kubernetes Fleet resource](#upgrade-hub-cluster-type-for-the-kubernetes-fleet-resource).
24
24
- This article also includes steps on joining member clusters. If you plan to follow along, you need at least one AKS cluster.
25
25
26
26
27
27
> [!IMPORTANT]
28
-
> Kubernetes Fleet resources without a hub cluster can be upgraded to fleet resource having a hub cluster. However, a Kubernetes Fleet resource already having a hub cluster can't be downgraded to Kubernetes Fleet resource without hub cluster.
29
-
> All configuration options and settings associated with the hub cluster based Kubernetes Fleet resource are immutable and can't be changed after creation or upgrade time.
30
-
> Upgrading from Kubernetes Fleet without hub cluster to one with a hub cluster can only be done through the Azure CLI. Currently there's no equivalent Azure portal experience.
28
+
> Kubernetes Fleet resources without a hub cluster can be upgraded to a Kubernetes Fleet resource with a hub cluster. However, a Kubernetes Fleet resource that already has a hub cluster can't be downgraded to a Kubernetes Fleet resource without a hub cluster.
29
+
> All configuration options and settings associated with Kubernetes Fleet resource that has a hub cluster are immutable and can't be changed after creation or upgrade time.
30
+
> Upgrading from a Kubernetes Fleet resource without a hub cluster to one with a hub cluster can only be done through the Azure CLI. Currently there's no equivalent Azure portal experience.
31
31
32
32
## Initial setup
33
33
@@ -48,16 +48,16 @@ az group create -n $RG -l $LOCATION
48
48
az fleet create -g $RG -n $FLEET
49
49
50
50
# Join member cluster to hubless fleet resource
51
-
az fleet member create -n $FLEET_MEMBER -f $FLEET -g $RG --member-cluster-id /subscriptions/$SUBSCRIPTION_ID/resourceGroups/$RG/providers/Microsoft.ContainerService/managedClusters/$CLUSTER
51
+
az fleet member create --name $FLEET_MEMBER --fleet-name $FLEET --resource-group $RG --member-cluster-id /subscriptions/$SUBSCRIPTION_ID/resourceGroups/$RG/providers/Microsoft.ContainerService/managedClusters/$CLUSTER
52
52
```
53
53
54
54
## Upgrade hub cluster type for the Kubernetes Fleet resource
55
55
56
-
To upgrade hub cluster type for the Kubernetes Fleet resource, use the `az fleet create` command with the `--enable-hub` flag set. Be sure to include any other relevant configuration options, as the fleet resource will become immutable after this operation is complete.
56
+
To upgrade the hub cluster type for the Kubernetes Fleet resource, use the `az fleet create` command with the `--enable-hub` flag set. Be sure to include any other relevant configuration options, as the fleet resource will become immutable after this operation is complete.
57
57
58
58
```azurecli-interactive
59
-
# Upgrade the Kubernetes fleet resource without hub cluster to one with a hub cluster
60
-
az fleet create -n $FLEET -g $RG --enable-hub
59
+
# Upgrade the Kubernetes fleet resource without a hub cluster to one with a hub cluster
60
+
az fleet create --name $FLEET --resource-group $RG --enable-hub
61
61
62
62
```
63
63
@@ -115,7 +115,7 @@ For each member cluster that you rejoin to the newly upgraded fleet, view the ou
115
115
116
116
You need access to the Kubernetes API of the hub cluster. If you don't have access, see [Access the Kubernetes API of the Fleet resource with Azure Kubernetes Fleet Manager](./quickstart-access-fleet-kubernetes-api.md).
117
117
118
-
To verify that your newly upgraded fleet resource is functioning properly and member clusters joined successfully, confirm that you're able to access the hub cluster's API server using the `kubectl get memberclusters` command.
118
+
To verify that your newly upgraded Kubernetes Fleet resource is functioning properly and that the member clusters joined successfully, confirm that you're able to access the hub cluster's API server using the `kubectl get memberclusters` command.
119
119
120
120
If successful, your output should look similar to the following example output:
0 commit comments