Skip to content

Commit cd96eef

Browse files
authored
Merge pull request #191238 from yossi-y/master
Update to billing
2 parents 451b2f8 + 70df67a commit cd96eef

File tree

1 file changed

+51
-39
lines changed

1 file changed

+51
-39
lines changed

articles/azure-monitor/logs/logs-dedicated-clusters.md

Lines changed: 51 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,7 @@ ms.custom: devx-track-azurepowershell, devx-track-azurecli
1212

1313
Azure Monitor Logs Dedicated Clusters are a deployment option that enables advanced capabilities for Azure Monitor Logs customers. Customers can select which of their Log Analytics workspaces should be hosted on dedicated clusters.
1414

15-
Dedicated clusters require customers to commit for at least 500 GB of data ingestion per day. You can migrate an existing workspace to a dedicated cluster with no data loss or service interruption.
15+
Dedicated clusters require customers to commit for at least 500 GB of data ingestion per day. You can link existing workspace to a dedicated cluster and unlink it with no data loss or service interruption.
1616

1717
Capabilities that require dedicated clusters:
1818

@@ -27,7 +27,7 @@ Capabilities that require dedicated clusters:
2727

2828
Dedicated clusters are managed with an Azure resource that represents Azure Monitor Log clusters. Operations are performed programmatically using [CLI](/cli/azure/monitor/log-analytics/cluster), [PowerShell](/powershell/module/az.operationalinsights) or the [REST](/rest/api/loganalytics/clusters).
2929

30-
Once a cluster is created, workspaces can be linked to it and new ingested data to them is stored on the cluster. Workspaces can be unlinked from a cluster at any time and new data is stored in shared Log Analytics clusters. The link and unlink operation doesn't affect your queries and the access to data before and after the operation with subjection to retention in workspaces. The Cluster and workspaces must be in the same region to allow linking.
30+
Once a cluster is created, workspaces can be linked to it, and new ingested data to them is stored on the cluster. Workspaces can be unlinked from a cluster at any time and new data then stored on shared Log Analytics clusters. The link and unlink operation doesn't affect your queries and access to data before, and after the operation. The Cluster and workspaces must be in the same region.
3131

3232
All operations on the cluster level require the `Microsoft.OperationalInsights/clusters/write` action permission on the cluster. This permission could be granted via the Owner or Contributor that contains the `*/write` action or via the Log Analytics Contributor role that contains the `Microsoft.OperationalInsights/*` action. For more information on Log Analytics permissions, see [Manage access to log data and workspaces in Azure Monitor](./manage-access.md).
3333

@@ -40,11 +40,13 @@ The cluster Commitment Tier level is configured programmatically with Azure Reso
4040

4141
There are two modes of billing for usage on a cluster. These can be specified by the `billingType` parameter when configuring your cluster.
4242

43-
1. **Cluster (default)**: Billing for ingested data is done at the cluster level. The ingested data quantities from each workspace associated to a cluster are aggregated to calculate the daily bill for the cluster.
43+
1. **Cluster (default)**--Billing for ingested data is done at the cluster level. The ingested data quantities from each workspace associated to a cluster are aggregated to calculate the daily bill for the cluster.
4444

45-
2. **Workspaces**: The Commitment Tier costs for your Cluster are attributed proportionately to the workspaces in the cluster, by each workspace's data ingestion volume (after accounting for per-node allocations from [Microsoft Defender for Cloud](../../security-center/index.yml) for each workspace.) This full details of this pricing model are explained [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
45+
2. **Workspaces**--The Commitment Tier costs for your Cluster are attributed proportionately to the workspaces in the cluster, by each workspace's data ingestion volume (after accounting for per-node allocations from [Microsoft Defender for Cloud](../../security-center/index.yml) for each workspace.) Details of pricing model are explained [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
4646

47-
If your workspace is using legacy Per Node pricing tier, when it is linked to a cluster it will be billed based on data ingested against the cluster's Commitment Tier, and no longer Per Node. Per-node data allocations from Microsoft Defender for Cloud will continue to be applied.
47+
If your linked workspace is using legacy Per Node pricing tier, it will be billed based on data ingested against the cluster's Commitment Tier, and no longer Per Node. Per-node data allocations from Microsoft Defender for Cloud will continue to be applied.
48+
49+
When you link workspaces to a cluster, the pricing tier is changed to cluster, and ingestion is billed based on cluster's Commitment Tier. Workspaces can be unlinked from a cluster at any time, and pricing tier change to per-GB.
4850

4951
Complete details are billing for Log Analytics dedicated clusters are available [here](./manage-cost-storage.md#log-analytics-dedicated-clusters).
5052

@@ -61,7 +63,7 @@ The user account that creates the clusters must have the standard Azure resource
6163

6264
After you create your cluster resource, you can edit additional properties such as *sku*, *keyVaultProperties, or *billingType*. See more details below.
6365

64-
You can have up to 2 active clusters per subscription per region. If the cluster is deleted, it is still reserved for 14 days. You can have up to 4 reserved clusters per subscription per region (active or recently deleted).
66+
You can have up to two active clusters per subscription per region. If the cluster is deleted, it is still reserved for 14 days. You can have up to four reserved clusters per subscription per region (active or recently deleted).
6567

6668
> [!NOTE]
6769
> Cluster creation triggers resource allocation and provisioning. This operation can take a few hours to complete.
@@ -329,20 +331,20 @@ Authorization: Bearer <token>
329331

330332
## Change cluster properties
331333

332-
After you create your cluster resource and it is fully provisioned, you can edit additional properties using CLI, PowerShell or REST API. The additional properties that can be set after the cluster has been provisioned include the following:
334+
After you create your cluster resource and it's fully provisioned, you can edit additional properties using CLI, PowerShell or REST API. The additional properties that can be set after the cluster has been provisioned include the following:
333335

334336
- **keyVaultProperties** - Contains the key in Azure Key Vault with the following parameters: *KeyVaultUri*, *KeyName*, *KeyVersion*. See [Update cluster with Key identifier details](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
335337
- **Identity** - The identity used to authenticate to your Key Vault. This can be System-assigned or User-assigned.
336338
- **billingType** - Billing attribution for the cluster resource and its data. Includes on the following values:
337-
- **Cluster (default)** - The costs for your cluster are attributed to the cluster resource.
338-
- **Workspaces** - The costs for your cluster are attributed proportionately to the workspaces in the Cluster, with the cluster resource being billed some of the usage if the total ingested data for the day is under the commitment tier. See [Log Analytics Dedicated Clusters](./manage-cost-storage.md#log-analytics-dedicated-clusters) to learn more about the cluster pricing model.
339+
- **Cluster (default)**--The costs for your cluster are attributed to the cluster resource.
340+
- **Workspaces**--The costs for your cluster are attributed proportionately to the workspaces in the Cluster, with the cluster resource being billed some of the usage if the total ingested data for the day is under the commitment tier. See [Log Analytics Dedicated Clusters](./manage-cost-storage.md#log-analytics-dedicated-clusters) to learn more about the cluster pricing model.
339341

340342

341343
>[!IMPORTANT]
342344
>Cluster update should not include both identity and key identifier details in the same operation. If you need to update both, the update should be in two consecutive operations.
343345
344346
> [!NOTE]
345-
> The *billingType* property is not supported in CLI.
347+
> The *billingType* property isn't supported in CLI.
346348
347349
## Get all clusters in resource group
348350

@@ -487,6 +489,14 @@ Content-type: application/json
487489

488490
### Update billingType in cluster
489491

492+
### PowerShell
493+
494+
```powershell
495+
Select-AzSubscription "cluster-subscription-id"
496+
497+
Update-AzOperationalInsightsCluster -ResourceGroupName "resource-group-name" -ClusterName "cluster-name" -BillingType "Workspaces"
498+
```
499+
490500
The *billingType* property determines the billing attribution for the cluster and its data:
491501
- *Cluster* (default) -- The billing is attributed to the Cluster resource
492502
- *Workspaces* -- The billing is attributed to linked workspaces proportionally. When data volume from all workspaces is below the Commitment Tier level, the remaining volume is attributed to the cluster
@@ -510,7 +520,7 @@ Content-type: application/json
510520

511521
### Unlink a workspace from cluster
512522

513-
You can unlink a workspace from a cluster. After unlinking a workspace from the cluster, new data associated with this workspace is not sent to the dedicated cluster. Also, the workspace billing is no longer done via the cluster.
523+
You can unlink a workspace from a cluster, and new data to workspace isn't ingested to cluster. Also, the workspace pricing tier is set to per-GB.
514524
Old data of the unlinked workspace might be left on the cluster. If this data is encrypted using customer-managed keys (CMK), the Key Vault secrets are kept. The system is abstracts this change from Log Analytics users. Users can just query the workspace as usual. The system performs cross-cluster queries on the backend as needed with no indication to users.
515525

516526
> [!WARNING]
@@ -540,13 +550,13 @@ Remove-AzOperationalInsightsLinkedService -ResourceGroupName "resource-group-nam
540550

541551
## Delete cluster
542552

543-
It's recommended that you unlink all workspaces from a dedicated cluster before deleting it. You need to have *write* permissions on the cluster resource. When deleting a cluster, you are losing access to all data ingested to the cluster from linked workspaces and from workspaces that were linked previously. This operation is not reversible. If you delete your cluster when workspaces are linked, these get unlinked automatically and new data get ingested to Log Analytics storage instead.
553+
It's recommended that you unlink all workspaces from a dedicated cluster before deleting it. You need to have *write* permissions on the cluster resource. When deleting a cluster, you're losing access to all data ingested to the cluster from linked workspaces and from workspaces that were linked previously. This operation isn't reversible. If you delete your cluster when workspaces are linked, these get unlinked automatically and new data get ingested to Log Analytics storage instead.
544554

545-
A cluster resource that was deleted in the last 14 days is kept in soft-delete state and its name remained reserved. After the soft-delete period, the cluster is permanently deleted and it's name can be used.
555+
A cluster resource that was deleted in the last 14 days is kept in soft-delete state and its name remained reserved. After the soft-delete period, the cluster is permanently deleted and its name can be reused to create a cluster.
546556

547557
> [!WARNING]
548558
> - The recovery of soft-deleted clusters isn't supported and it can't be recovered once deleted.
549-
> - There is a limit of 4 clusters per subscription. Both active and soft-deleted clusters are counted as part of this. Customers should not create recurrent procedures that create and delete clusters. It has a significant impact on Log Analytics backend systems.
559+
> - There is a limit of 4 clusters per subscription. Both active and soft-deleted clusters are counted as part of this. Customers shouldn't create recurrent procedures that create and delete clusters. It has a significant impact on Log Analytics backend systems.
550560
551561
Use the following commands to delete a cluster:
552562

@@ -600,11 +610,13 @@ Authorization: Bearer <token>
600610

601611
- [Double encryption](../../storage/common/storage-service-encryption.md#doubly-encrypt-data-with-infrastructure-encryption) is configured automatically for clusters created from October 2020 in supported regions. You can verify if your cluster is configured for double encryption by sending a GET request on the cluster and observing that the `isDoubleEncryptionEnabled` value is `true` for clusters with Double encryption enabled.
602612
- If you create a cluster and get an error "region-name doesn't support Double Encryption for clusters.", you can still create the cluster without Double encryption by adding `"properties": {"isDoubleEncryptionEnabled": false}` in the REST request body.
603-
- Double encryption setting can not be changed after the cluster has been created.
613+
- Double encryption setting can't can not be changed after the cluster has been created.
614+
615+
- Deleting a linked workspace is permitted while linked to cluster. If you decide to [recover](./delete-workspace.md#recover-workspace) the workspace during the [soft-delete](./delete-workspace.md#soft-delete-behavior) period, it returns to previous state and remains linked to cluster.
604616

605617
## Troubleshooting
606618

607-
- If you get conflict error when creating a cluster, it may be that you have deleted your cluster in the last 14 days and it's in a soft-delete state. The cluster name remains reserved during the soft-delete period and you can't create a new cluster with that name. The name is released after the soft-delete period when the cluster is permanently deleted.
619+
- If you get conflict error when creating a cluster, it may be that you've deleted your cluster in the last 14 days and it's in a soft-delete state. The cluster name remains reserved during the soft-delete period and you can't create a new cluster with that name. The name is released after the soft-delete period when the cluster is permanently deleted.
608620

609621
- If you update your cluster while the cluster is at provisioning or updating state, the update will fail.
610622

@@ -616,43 +628,43 @@ Authorization: Bearer <token>
616628

617629
### Cluster Create
618630

619-
- 400 -- Cluster name is not valid. Cluster name can contain characters a-z, A-Z, 0-9 and length of 3-63.
620-
- 400 -- The body of the request is null or in bad format.
621-
- 400 -- SKU name is invalid. Set SKU name to capacityReservation.
622-
- 400 -- Capacity was provided but SKU is not capacityReservation. Set SKU name to capacityReservation.
623-
- 400 -- Missing Capacity in SKU. Set Capacity value to 500, 1000, 2000 or 5000 GB/day.
624-
- 400 -- Capacity is locked for 30 days. Decreasing capacity is permitted 30 days after update.
625-
- 400 -- No SKU was set. Set the SKU name to capacityReservation and Capacity value to 500, 1000, 2000 or 5000 GB/day.
626-
- 400 -- Identity is null or empty. Set Identity with systemAssigned type.
627-
- 400 -- KeyVaultProperties are set on creation. Update KeyVaultProperties after cluster creation.
628-
- 400 -- Operation cannot be executed now. Async operation is in a state other than succeeded. Cluster must complete its operation before any update operation is performed.
631+
- 400--Cluster name is not valid. Cluster name can contain characters a-z, A-Z, 0-9 and length of 3-63.
632+
- 400--The body of the request is null or in bad format.
633+
- 400--SKU name is invalid. Set SKU name to capacityReservation.
634+
- 400--Capacity was provided but SKU is not capacityReservation. Set SKU name to capacityReservation.
635+
- 400--Missing Capacity in SKU. Set Capacity value to 500, 1000, 2000 or 5000 GB/day.
636+
- 400--Capacity is locked for 30 days. Decreasing capacity is permitted 30 days after update.
637+
- 400--No SKU was set. Set the SKU name to capacityReservation and Capacity value to 500, 1000, 2000 or 5000 GB/day.
638+
- 400--Identity is null or empty. Set Identity with systemAssigned type.
639+
- 400--KeyVaultProperties are set on creation. Update KeyVaultProperties after cluster creation.
640+
- 400--Operation cannot be executed now. Async operation is in a state other than succeeded. Cluster must complete its operation before any update operation is performed.
629641

630642
### Cluster Update
631643

632-
- 400 -- Cluster is in deleting state. Async operation is in progress . Cluster must complete its operation before any update operation is performed.
633-
- 400 -- KeyVaultProperties is not empty but has a bad format. See [key identifier update](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
634-
- 400 -- Failed to validate key in Key Vault. Could be due to lack of permissions or when key doesn't exist. Verify that you [set key and access policy](../logs/customer-managed-keys.md#grant-key-vault-permissions) in Key Vault.
635-
- 400 -- Key is not recoverable. Key Vault must be set to Soft-delete and Purge-protection. See [Key Vault documentation](../../key-vault/general/soft-delete-overview.md)
636-
- 400 -- Operation cannot be executed now. Wait for the Async operation to complete and try again.
637-
- 400 -- Cluster is in deleting state. Wait for the Async operation to complete and try again.
644+
- 400--Cluster is in deleting state. Async operation is in progress. Cluster must complete its operation before any update operation is performed.
645+
- 400--KeyVaultProperties is not empty but has a bad format. See [key identifier update](../logs/customer-managed-keys.md#update-cluster-with-key-identifier-details).
646+
- 400--Failed to validate key in Key Vault. Could be due to lack of permissions or when key doesn't exist. Verify that you [set key and access policy](../logs/customer-managed-keys.md#grant-key-vault-permissions) in Key Vault.
647+
- 400--Key is not recoverable. Key Vault must be set to Soft-delete and Purge-protection. See [Key Vault documentation](../../key-vault/general/soft-delete-overview.md)
648+
- 400--Operation cannot be executed now. Wait for the Async operation to complete and try again.
649+
- 400--Cluster is in deleting state. Wait for the Async operation to complete and try again.
638650

639651
### Cluster Get
640652

641-
- 404 -- Cluster not found, the cluster may have been deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it, or use another name to create a new cluster.
653+
- 404--Cluster not found, the cluster may have been deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it, or use another name to create a new cluster.
642654

643655
### Cluster Delete
644656

645-
- 409 -- Can't delete a cluster while in provisioning state. Wait for the Async operation to complete and try again.
657+
- 409--Can't delete a cluster while in provisioning state. Wait for the Async operation to complete and try again.
646658

647659
### Workspace link
648660

649-
- 404 -- Workspace not found. The workspace you specified doesn't exist or was deleted.
650-
- 409 -- Workspace link or unlink operation in process.
651-
- 400 -- Cluster not found, the cluster you specified doesn't exist or was deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it.
661+
- 404--Workspace not found. The workspace you specified doesn't exist or was deleted.
662+
- 409--Workspace link or unlink operation in process.
663+
- 400--Cluster not found, the cluster you specified doesn't exist or was deleted. If you try to create a cluster with that name and get conflict, the cluster is in soft-delete for 14 days. You can contact support to recover it.
652664

653665
### Workspace unlink
654-
- 404 -- Workspace not found. The workspace you specified doesn't exist or was deleted.
655-
- 409 -- Workspace link or unlink operation in process.
666+
- 404--Workspace not found. The workspace you specified doesn't exist or was deleted.
667+
- 409--Workspace link or unlink operation in process.
656668

657669
## Next steps
658670

0 commit comments

Comments
 (0)