You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Azure Monitor Logs Dedicated Clusters are a deployment option that enables advanced capabilities for Azure Monitor Logs customers. Customers can select which of their Log Analytics workspaces should be hosted on dedicated clusters.
14
14
15
-
Dedicated clusters require customers to commit for at least 500 GB of data ingestion per day. You can migrate an existing workspace to a dedicated cluster with no data loss or service interruption.
15
+
Dedicated clusters require customers to commit for at least 500 GB of data ingestion per day. You can link existing workspace to a dedicated cluster and unlink it with no data loss or service interruption.
16
16
17
17
Capabilities that require dedicated clusters:
18
18
@@ -27,7 +27,7 @@ Capabilities that require dedicated clusters:
27
27
28
28
Dedicated clusters are managed with an Azure resource that represents Azure Monitor Log clusters. Operations are performed programmatically using [CLI](/cli/azure/monitor/log-analytics/cluster), [PowerShell](/powershell/module/az.operationalinsights) or the [REST](/rest/api/loganalytics/clusters).
29
29
30
-
Once a cluster is created, workspaces can be linked to it and new ingested data to them is stored on the cluster. Workspaces can be unlinked from a cluster at any time and new data is stored in shared Log Analytics clusters. The link and unlink operation doesn't affect your queries and the access to data before and after the operation with subjection to retention in workspaces. The Cluster and workspaces must be in the same region to allow linking.
30
+
Once a cluster is created, workspaces can be linked to it, and new ingested data to them is stored on the cluster. Workspaces can be unlinked from a cluster at any time and new data then stored on shared Log Analytics clusters. The link and unlink operation doesn't affect your queries and access to data before, and after the operation. The Cluster and workspaces must be in the same region.
31
31
32
32
All operations on the cluster level require the `Microsoft.OperationalInsights/clusters/write` action permission on the cluster. This permission could be granted via the Owner or Contributor that contains the `*/write` action or via the Log Analytics Contributor role that contains the `Microsoft.OperationalInsights/*` action. For more information on Log Analytics permissions, see [Manage access to log data and workspaces in Azure Monitor](./manage-access.md).
33
33
@@ -40,11 +40,13 @@ The cluster Commitment Tier level is configured programmatically with Azure Reso
40
40
41
41
There are two modes of billing for usage on a cluster. These can be specified by the `billingType` parameter when configuring your cluster.
42
42
43
-
1.**Cluster (default)**: Billing for ingested data is done at the cluster level. The ingested data quantities from each workspace associated to a cluster are aggregated to calculate the daily bill for the cluster.
43
+
1.**Cluster (default)**--Billing for ingested data is done at the cluster level. The ingested data quantities from each workspace associated to a cluster are aggregated to calculate the daily bill for the cluster.
44
44
45
-
2.**Workspaces**: The Commitment Tier costs for your Cluster are attributed proportionately to the workspaces in the cluster, by each workspace's data ingestion volume (after accounting for per-node allocations from [Microsoft Defender for Cloud](../../security-center/index.yml) for each workspace.) This full details of this pricing model are explained [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
45
+
2.**Workspaces**--The Commitment Tier costs for your Cluster are attributed proportionately to the workspaces in the cluster, by each workspace's data ingestion volume (after accounting for per-node allocations from [Microsoft Defender for Cloud](../../security-center/index.yml) for each workspace.) Details of pricing model are explained [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
46
46
47
-
If your workspace is using legacy Per Node pricing tier, when it is linked to a cluster it will be billed based on data ingested against the cluster's Commitment Tier, and no longer Per Node. Per-node data allocations from Microsoft Defender for Cloud will continue to be applied.
47
+
If your linked workspace is using legacy Per Node pricing tier, it will be billed based on data ingested against the cluster's Commitment Tier, and no longer Per Node. Per-node data allocations from Microsoft Defender for Cloud will continue to be applied.
48
+
49
+
When you link workspaces to a cluster, the pricing tier is changed to cluster, and ingestion is billed based on cluster's Commitment Tier. Workspaces can be unlinked from a cluster at any time, and pricing tier change to per-GB.
48
50
49
51
Complete details are billing for Log Analytics dedicated clusters are available [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
50
52
@@ -61,7 +63,7 @@ The user account that creates the clusters must have the standard Azure resource
61
63
62
64
After you create your cluster resource, you can edit additional properties such as *sku*, *keyVaultProperties, or *billingType*. See more details below.
63
65
64
-
You can have up to 2 active clusters per subscription per region. If the cluster is deleted, it is still reserved for 14 days. You can have up to 4 reserved clusters per subscription per region (active or recently deleted).
66
+
You can have up to two active clusters per subscription per region. If the cluster is deleted, it is still reserved for 14 days. You can have up to four reserved clusters per subscription per region (active or recently deleted).
65
67
66
68
> [!NOTE]
67
69
> Cluster creation triggers resource allocation and provisioning. This operation can take a few hours to complete.
After you create your cluster resource and it is fully provisioned, you can edit additional properties using CLI, PowerShell or REST API. The additional properties that can be set after the cluster has been provisioned include the following:
334
+
After you create your cluster resource and it's fully provisioned, you can edit additional properties using CLI, PowerShell or REST API. The additional properties that can be set after the cluster has been provisioned include the following:
333
335
334
336
-**keyVaultProperties** - Contains the key in Azure Key Vault with the following parameters: *KeyVaultUri*, *KeyName*, *KeyVersion*. See [Update cluster with Key identifier details](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
335
337
-**Identity** - The identity used to authenticate to your Key Vault. This can be System-assigned or User-assigned.
336
338
-**billingType** - Billing attribution for the cluster resource and its data. Includes on the following values:
337
-
-**Cluster (default)** - The costs for your cluster are attributed to the cluster resource.
338
-
-**Workspaces** - The costs for your cluster are attributed proportionately to the workspaces in the Cluster, with the cluster resource being billed some of the usage if the total ingested data for the day is under the commitment tier. See [Log Analytics Dedicated Clusters](./manage-cost-storage.md#log-analytics-dedicated-clusters) to learn more about the cluster pricing model.
339
+
-**Cluster (default)**--The costs for your cluster are attributed to the cluster resource.
340
+
-**Workspaces**--The costs for your cluster are attributed proportionately to the workspaces in the Cluster, with the cluster resource being billed some of the usage if the total ingested data for the day is under the commitment tier. See [Log Analytics Dedicated Clusters](./manage-cost-storage.md#log-analytics-dedicated-clusters) to learn more about the cluster pricing model.
339
341
340
342
341
343
>[!IMPORTANT]
342
344
>Cluster update should not include both identity and key identifier details in the same operation. If you need to update both, the update should be in two consecutive operations.
343
345
344
346
> [!NOTE]
345
-
> The *billingType* property is not supported in CLI.
347
+
> The *billingType* property isn't supported in CLI.
The *billingType* property determines the billing attribution for the cluster and its data:
491
501
-*Cluster* (default) -- The billing is attributed to the Cluster resource
492
502
-*Workspaces* -- The billing is attributed to linked workspaces proportionally. When data volume from all workspaces is below the Commitment Tier level, the remaining volume is attributed to the cluster
You can unlink a workspace from a cluster. After unlinking a workspace from the cluster, new data associated with this workspace is not sent to the dedicated cluster. Also, the workspace billing is no longer done via the cluster.
523
+
You can unlink a workspace from a cluster, and new data to workspace isn't ingested to cluster. Also, the workspace pricing tier is set to per-GB.
514
524
Old data of the unlinked workspace might be left on the cluster. If this data is encrypted using customer-managed keys (CMK), the Key Vault secrets are kept. The system is abstracts this change from Log Analytics users. Users can just query the workspace as usual. The system performs cross-cluster queries on the backend as needed with no indication to users.
It's recommended that you unlink all workspaces from a dedicated cluster before deleting it. You need to have *write* permissions on the cluster resource. When deleting a cluster, you are losing access to all data ingested to the cluster from linked workspaces and from workspaces that were linked previously. This operation is not reversible. If you delete your cluster when workspaces are linked, these get unlinked automatically and new data get ingested to Log Analytics storage instead.
553
+
It's recommended that you unlink all workspaces from a dedicated cluster before deleting it. You need to have *write* permissions on the cluster resource. When deleting a cluster, you're losing access to all data ingested to the cluster from linked workspaces and from workspaces that were linked previously. This operation isn't reversible. If you delete your cluster when workspaces are linked, these get unlinked automatically and new data get ingested to Log Analytics storage instead.
544
554
545
-
A cluster resource that was deleted in the last 14 days is kept in soft-delete state and its name remained reserved. After the soft-delete period, the cluster is permanently deleted and it's name can be used.
555
+
A cluster resource that was deleted in the last 14 days is kept in soft-delete state and its name remained reserved. After the soft-delete period, the cluster is permanently deleted and its name can be reused to create a cluster.
546
556
547
557
> [!WARNING]
548
558
> - The recovery of soft-deleted clusters isn't supported and it can't be recovered once deleted.
549
-
> - There is a limit of 4 clusters per subscription. Both active and soft-deleted clusters are counted as part of this. Customers should not create recurrent procedures that create and delete clusters. It has a significant impact on Log Analytics backend systems.
559
+
> - There is a limit of 4 clusters per subscription. Both active and soft-deleted clusters are counted as part of this. Customers shouldn't create recurrent procedures that create and delete clusters. It has a significant impact on Log Analytics backend systems.
-[Double encryption](../../storage/common/storage-service-encryption.md#doubly-encrypt-data-with-infrastructure-encryption) is configured automatically for clusters created from October 2020 in supported regions. You can verify if your cluster is configured for double encryption by sending a GET request on the cluster and observing that the `isDoubleEncryptionEnabled` value is `true` for clusters with Double encryption enabled.
602
612
- If you create a cluster and get an error "region-name doesn't support Double Encryption for clusters.", you can still create the cluster without Double encryption by adding `"properties": {"isDoubleEncryptionEnabled": false}` in the REST request body.
603
-
- Double encryption setting can not be changed after the cluster has been created.
613
+
- Double encryption setting can't can not be changed after the cluster has been created.
614
+
615
+
- Deleting a linked workspace is permitted while linked to cluster. If you decide to [recover](./delete-workspace.md#recover-workspace) the workspace during the [soft-delete](./delete-workspace.md#soft-delete-behavior) period, it returns to previous state and remains linked to cluster.
604
616
605
617
## Troubleshooting
606
618
607
-
- If you get conflict error when creating a cluster, it may be that you have deleted your cluster in the last 14 days and it's in a soft-delete state. The cluster name remains reserved during the soft-delete period and you can't create a new cluster with that name. The name is released after the soft-delete period when the cluster is permanently deleted.
619
+
- If you get conflict error when creating a cluster, it may be that you've deleted your cluster in the last 14 days and it's in a soft-delete state. The cluster name remains reserved during the soft-delete period and you can't create a new cluster with that name. The name is released after the soft-delete period when the cluster is permanently deleted.
608
620
609
621
- If you update your cluster while the cluster is at provisioning or updating state, the update will fail.
- 400 -- Cluster name is not valid. Cluster name can contain characters a-z, A-Z, 0-9 and length of 3-63.
620
-
- 400 -- The body of the request is null or in bad format.
621
-
- 400 -- SKU name is invalid. Set SKU name to capacityReservation.
622
-
- 400 -- Capacity was provided but SKU is not capacityReservation. Set SKU name to capacityReservation.
623
-
- 400 -- Missing Capacity in SKU. Set Capacity value to 500, 1000, 2000 or 5000 GB/day.
624
-
- 400 -- Capacity is locked for 30 days. Decreasing capacity is permitted 30 days after update.
625
-
- 400 -- No SKU was set. Set the SKU name to capacityReservation and Capacity value to 500, 1000, 2000 or 5000 GB/day.
626
-
- 400 -- Identity is null or empty. Set Identity with systemAssigned type.
627
-
- 400 -- KeyVaultProperties are set on creation. Update KeyVaultProperties after cluster creation.
628
-
- 400 -- Operation cannot be executed now. Async operation is in a state other than succeeded. Cluster must complete its operation before any update operation is performed.
631
+
- 400--Cluster name is not valid. Cluster name can contain characters a-z, A-Z, 0-9 and length of 3-63.
632
+
- 400--The body of the request is null or in bad format.
633
+
- 400--SKU name is invalid. Set SKU name to capacityReservation.
634
+
- 400--Capacity was provided but SKU is not capacityReservation. Set SKU name to capacityReservation.
635
+
- 400--Missing Capacity in SKU. Set Capacity value to 500, 1000, 2000 or 5000 GB/day.
636
+
- 400--Capacity is locked for 30 days. Decreasing capacity is permitted 30 days after update.
637
+
- 400--No SKU was set. Set the SKU name to capacityReservation and Capacity value to 500, 1000, 2000 or 5000 GB/day.
638
+
- 400--Identity is null or empty. Set Identity with systemAssigned type.
639
+
- 400--KeyVaultProperties are set on creation. Update KeyVaultProperties after cluster creation.
640
+
- 400--Operation cannot be executed now. Async operation is in a state other than succeeded. Cluster must complete its operation before any update operation is performed.
629
641
630
642
### Cluster Update
631
643
632
-
- 400 -- Cluster is in deleting state. Async operation is in progress. Cluster must complete its operation before any update operation is performed.
633
-
- 400 -- KeyVaultProperties is not empty but has a bad format. See [key identifier update](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
634
-
- 400 -- Failed to validate key in Key Vault. Could be due to lack of permissions or when key doesn't exist. Verify that you [set key and access policy](../logs/customer-managed-keys.md#grant-key-vault-permissions) in Key Vault.
635
-
- 400 -- Key is not recoverable. Key Vault must be set to Soft-delete and Purge-protection. See [Key Vault documentation](../../key-vault/general/soft-delete-overview.md)
636
-
- 400 -- Operation cannot be executed now. Wait for the Async operation to complete and try again.
637
-
- 400 -- Cluster is in deleting state. Wait for the Async operation to complete and try again.
644
+
- 400--Cluster is in deleting state. Async operation is in progress. Cluster must complete its operation before any update operation is performed.
645
+
- 400--KeyVaultProperties is not empty but has a bad format. See [key identifier update](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
646
+
- 400--Failed to validate key in Key Vault. Could be due to lack of permissions or when key doesn't exist. Verify that you [set key and access policy](../logs/customer-managed-keys.md#grant-key-vault-permissions) in Key Vault.
647
+
- 400--Key is not recoverable. Key Vault must be set to Soft-delete and Purge-protection. See [Key Vault documentation](../../key-vault/general/soft-delete-overview.md)
648
+
- 400--Operation cannot be executed now. Wait for the Async operation to complete and try again.
649
+
- 400--Cluster is in deleting state. Wait for the Async operation to complete and try again.
638
650
639
651
### Cluster Get
640
652
641
-
- 404 -- Cluster not found, the cluster may have been deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it, or use another name to create a new cluster.
653
+
- 404--Cluster not found, the cluster may have been deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it, or use another name to create a new cluster.
642
654
643
655
### Cluster Delete
644
656
645
-
- 409 -- Can't delete a cluster while in provisioning state. Wait for the Async operation to complete and try again.
657
+
- 409--Can't delete a cluster while in provisioning state. Wait for the Async operation to complete and try again.
646
658
647
659
### Workspace link
648
660
649
-
- 404 -- Workspace not found. The workspace you specified doesn't exist or was deleted.
650
-
- 409 -- Workspace link or unlink operation in process.
651
-
- 400 -- Cluster not found, the cluster you specified doesn't exist or was deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it.
661
+
- 404--Workspace not found. The workspace you specified doesn't exist or was deleted.
662
+
- 409--Workspace link or unlink operation in process.
663
+
- 400--Cluster not found, the cluster you specified doesn't exist or was deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it.
652
664
653
665
### Workspace unlink
654
-
- 404 -- Workspace not found. The workspace you specified doesn't exist or was deleted.
655
-
- 409 -- Workspace link or unlink operation in process.
666
+
- 404--Workspace not found. The workspace you specified doesn't exist or was deleted.
667
+
- 409--Workspace link or unlink operation in process.
0 commit comments