Skip to content

Commit eb08fb0

Browse files
Learn Build Service GitHub AppLearn Build Service GitHub App
authored andcommitted
Merging changes synced from https://github.com/MicrosoftDocs/dataexplorer-docs-pr (branch live)
2 parents 59d9d18 + b669e98 commit eb08fb0

File tree

16 files changed

+31
-4
lines changed

16 files changed

+31
-4
lines changed
Binary file not shown.

data-explorer/kusto-tocs/management/toc.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -365,7 +365,7 @@ items:
365365
items:
366366
- name: Capacity policy
367367
href: /kusto/management/capacity-policy?view=azure-data-explorer&preserve-view=true
368-
displayName: IngestionCapacity, ExtentsMergeCapacity, ExtentsPurgeRebuildCapacity, ExportCapacity, ExtentsPartitionCapacity, MaterializedViewsCapacity, StoredQueryResultsCapacity, ingestion, extents,
368+
displayName: IngestionCapacity, ExtentsMergeCapacity, ExtentsPurgeRebuildCapacity, ExportCapacity, ExtentsPartitionCapacity, MaterializedViewsCapacity, StoredQueryResultsCapacity, QueryAccelerationCapacity, ingestion, extents,
369369
purge, partition
370370
- name: .alter cluster policy capacity command
371371
href: /kusto/management/alter-capacity-policy-command?view=azure-data-explorer&preserve-view=true
17.9 KB
Loading

data-explorer/kusto/management/alter-capacity-policy-command.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -97,6 +97,10 @@ Alter the capacity policy. The resulting policy is the properties in the command
9797
},
9898
"PeriodicStorageArtifactsCleanupCapacity": {
9999
"MaximumConcurrentOperationsPerCluster": 1
100+
},
101+
"QueryAccelerationCapacity": {
102+
"ClusterMaximumConcurrentOperations": 100,
103+
"CoreUtilizationCoefficient": 0.5
100104
}
101105
},
102106
"ChildEntities": ,

data-explorer/kusto/management/capacity-policy.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ The capacity policy is made of the following components:
2626
* [StreamingIngestionPostProcessingCapacity](#streaming-ingestion-post-processing-capacity)
2727
* [PurgeStorageArtifactsCleanupCapacity](#purge-storage-artifacts-cleanup-capacity)
2828
* [PeriodicStorageArtifactsCleanupCapacity](#periodic-storage-artifacts-cleanup-capacity)
29+
* [QueryAccelerationCapacity](#query-acceleration-capacity)
2930

3031
To view the capacity of your cluster, use the [.show capacity](show-capacity-command.md) command.
3132

@@ -179,6 +180,19 @@ The [.show capacity](show-capacity-command.md) command returns the cluster's per
179180

180181
`MaximumConcurrentOperationsPerCluster`
181182

183+
### Query Acceleration capacity
184+
185+
| Property | Type | Description |
186+
|--|--|--|
187+
| `ClusterMaximumConcurrentOperations` | `long` | The maximum number of concurrent query acceleration caching operations in a cluster. This value caps the total query acceleration caching capacity, as shown in the following formula. |
188+
| `CoreUtilizationCoefficient` | `long` | Determines the percentage of cores to use in the query acceleration caching capacity calculation. |
189+
190+
**Formula**
191+
192+
The [.show capacity](show-capacity-command.md) command returns the cluster's query acceleration caching capacity based on the following formula:
193+
194+
`Minimum(ClusterMaximumConcurrentOperations` `,` *Number of nodes in cluster* `*` `Maximum(1,` *Core count per node* `*` `CoreUtilizationCoefficient))`
195+
182196
## Defaults
183197

184198
The default capacity policy has the following JSON representation:
@@ -223,6 +237,10 @@ The default capacity policy has the following JSON representation:
223237
},
224238
"PeriodicStorageArtifactsCleanupCapacity": {
225239
"MaximumConcurrentOperationsPerCluster": 2
240+
},
241+
"QueryAccelerationCapacity": {
242+
"ClusterMaximumConcurrentOperations": 100,
243+
"CoreUtilizationCoefficient": 0.5
226244
}
227245
}
228246
```
@@ -247,6 +265,8 @@ Kusto limits the number of concurrent requests for the following user-initiated
247265
* The [purge rebuild capacity](#extents-purge-rebuild-capacity) is used internally to determine the number of concurrent rebuild operations during purge commands. Purge commands aren't blocked or throttled because of this process, but completes faster or slower depending on the purge rebuild capacity.
248266
* **Exports**
249267
* The limit is as defined in the [export capacity](#export-capacity).
268+
* **Query Acceleration**
269+
* The limit is as defined in the [query acceleration capacity](#query-acceleration-capacity).
250270

251271
When the cluster detects that an operation exceeded the limit on concurrent requests:
252272

data-explorer/kusto/management/query-acceleration-policy.md

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,11 +29,14 @@ To enable query acceleration in the Fabric UI, see [Query acceleration over OneL
2929
* The feature assumes delta tables with static advanced features, for example column mapping doesn't change, partitions don't change, and so on. To change advanced features, first disable the policy, and once the change is made, re-enable the policy.
3030
* Schema changes on the delta table must also be followed with the respective `.alter` external delta table schema, which might result in acceleration starting from scratch if there was breaking schema change.
3131
* Index-based pruning isn't supported for partitions.
32-
* Parquet files with a compressed size higher than 6 GB won't be cached.
32+
* Parquet files larger than 1 GB won't be cached.
3333
::: moniker range="azure-data-explorer"
3434
* Query acceleration isn't supported for external tables with impersonation authentication.
3535
::: moniker-end
3636

37+
> [!NOTE]
38+
> The query acceleration caching operations are limited by the available query acceleration capacity of your cluster. Run the [.show capacity command](show-capacity-command.md) to view the total, consumed, and remaining query acceleration capacity.
39+
3740
## Known issues
3841

3942
* Data in the external delta table that is optimized with the [OPTIMIZE](/azure/databricks/sql/language-manual/delta-optimize) function will need to be reaccelearted.

data-explorer/kusto/management/toc.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -367,7 +367,7 @@ items:
367367
items:
368368
- name: Capacity policy
369369
href: capacity-policy.md
370-
displayName: IngestionCapacity, ExtentsMergeCapacity, ExtentsPurgeRebuildCapacity, ExportCapacity, ExtentsPartitionCapacity, MaterializedViewsCapacity, StoredQueryResultsCapacity, ingestion, extents, purge, partition
370+
displayName: IngestionCapacity, ExtentsMergeCapacity, ExtentsPurgeRebuildCapacity, ExportCapacity, ExtentsPartitionCapacity, MaterializedViewsCapacity, StoredQueryResultsCapacity, QueryAccelerationCapacity, ingestion, extents, purge, partition
371371
- name: .alter cluster policy capacity command
372372
href: alter-capacity-policy-command.md
373373
displayName: .alter cluster capacity policy command

data-explorer/kusto/query/regex-quote-function.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,4 +42,4 @@ print result = regex_quote('(so$me.Te^xt)')
4242

4343
| result |
4444
|---|
45-
| `\(so\\$me\\.Te\\^xt\\)` |
45+
| `\(so\$me\.Te\^xt\)` |
14.1 KB
Loading
-9.58 KB
Loading

0 commit comments

Comments
 (0)