Skip to content

Commit f7cab82

Browse files
Merge pull request #276921 from tedvilutis/patch-1
Update migration-to-adx.md
2 parents 3a0ebe0 + 07623b2 commit f7cab82

File tree

1 file changed

+17
-17
lines changed

1 file changed

+17
-17
lines changed
Lines changed: 17 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -1,12 +1,12 @@
11
---
22
title: 'Migrating to Azure Data Explorer | Microsoft Docs'
3-
description: How to migrate Azure Time Series Insights environments to Azure Data Explorer.
3+
Description: How to migrate Azure Time Series Insights environments to Azure Data Explorer.
44
ms.service: time-series-insights
55
author: tedvilutis
6-
ms.author: tvilutis
6+
ms.author: atributes
77
ms.topic: conceptual
88
ms.date: 3/15/2022
9-
ms.custom: tvilutis
9+
ms.custom: atributes
1010
---
1111

1212
# Migrating to Azure Data Explorer
@@ -18,7 +18,7 @@ ms.custom: tvilutis
1818
Time Series Insights (TSI) service provides access to historical data ingested through hubs for operational analytics and reporting. Service features are:
1919
- Data ingestion via hubs or bulk upload capability.
2020
- Data storage on hot, limited retention, and cold, infinite retention, paths.
21-
- Data contextualization applying hierarchies through Time Series Model.
21+
- Data contextualization applying hierarchies through the Time Series Model.
2222
- Data charting and operational analysis through TSI Explorer.
2323
- Data query using TSQ through API or TSI Explorer.
2424
- Connectors to access data with Databricks Spark or PBI.
@@ -29,42 +29,42 @@ Time Series Insights (TSI) service provides access to historical data ingested t
2929
| Feature | TSI | ADX |
3030
| ---| ---| ---|
3131
| Data ingestion | Event Hubs, IoT hub limited to 1 MB/s | Event Hubs, IoT hub, Kafka, Spark, Azure storage, Azure Stream Analytics, Azure Data Factory, Logstash, Power automate, Logic apps, Telegraf, Apache Nifi. No limits on ingestion (scalable), Ingestion benchmark is 200 MB/s/node on a 16 core machine in ADX cluster. |
32-
| Data storage and retention | Warm store – multitenant ADX Cluster | Cold Store - Azure Blob storage in customer’s subscription Distributed columnar store with highly optimized hot(on SSD of compute nodes) and cold(on Azure storage) store. Choose any ADX SKU so full flexibility |
33-
| Data formats | JSON | JSON, CSV, Avro, Parquet, ORC, TXT and various others [Data formats supported by Azure Data Explorer for ingestion](/azure/data-explorer/ingestion-supported-formats). |
32+
| Data storage and retention | Warm store – multitenant ADX Cluster | Cold Store - Azure Blob storage in customer’s subscription Distributed columnar store with highly optimized hot(on SSD of compute nodes) and cold(on Azure storage) store. Choose any ADX SKU for full flexibility |
33+
| Data formats | JSON | JSON, CSV, Avro, Parquet, ORC, TXT, and various others [Data formats supported by Azure Data Explorer for ingestion](/azure/data-explorer/ingestion-supported-formats). |
3434
| Data Querying | TSQ | KQL, SQL |
35-
| Data Visualization | TSI Explorer, PBI | PBI, ADX Dashboards, Grafana, Kibana and other visualization tools using ODBC/JDBC connectors |
36-
| Machine Learning | NA | Supports R, Python to build ML models or score data by exporting existing ML models. Native capabilities for forecasting. Anomaly detection at scale. Clustering capabilities for diagnostics and RCA |
35+
| Data Visualization | TSI Explorer, PBI | PBI, ADX Dashboards, Grafana, Kibana, and other visualization tools using ODBC/JDBC connectors |
36+
| Machine Learning | NA | Supports R and Python in building ML models or scoring data by exporting existing models. Native capabilities for forecasting. Anomaly detection at scale. Clustering capabilities for diagnostics and RCA |
3737
| PBI Connector | Public preview | Optimized native PBI connector(GA), supports direct query or import mode, supports query parameters and filters |
3838
| Data Export | Data is available as Parquet files in BLOB storage | Supports automatic continuous export to Azure storage, external tables to query exported data |
39-
| HA/DR | Storage is owned by customer so depends on selected config. | HA SLA of 99.9% availability, AZ supported, Storage is built on durable Azure Blob storage |
40-
| Security | Private link for incoming traffic, but open for storage and hubs | VNet injection, Private Link, Encryption at rest with customer managed keys supported |
39+
| Customer owns HA/DR | Storage, so it depends on the selected config. | HA SLA of 99.9% availability, AZ supported, Storage is built on durable Azure Blob storage |
40+
| Security | Private link for incoming traffic, but open for storage and hubs | VNet injection, Private Link, Encryption at rest with customer-managed keys supported |
4141
| RBAC role and RLS | Limited RBAC role, no RLS | Granular RBAC role for functions and data access, RLS and data masking supported |
4242

4343
## TSI Migration to ADX Steps
4444

45-
TSI has two offerings, Gen1 and Gen2, which have different migration steps.
45+
TSI has two offerings, Gen1 and Gen2, with different migration steps.
4646

4747
### TSI Gen1
4848

49-
TSI Gen1 doesn’t have cold storage or hierarchy capability. All data has fixed retention. Extracting data and mapping it to ADX would be complicated and time-consuming task for TSI developers and the customer. Suggestion migration path is to set up parallel data ingestion to ADX. After fixed data retention period passes TSI environment can be deleted as ADX will contain same data.
49+
TSI Gen1 doesn’t have cold Storage or hierarchy capability. All data has fixed retention. Extracting data and mapping it to ADX would be complicated and time-consuming for TSI developers and the customer. The suggested migration path is to set up parallel data ingestion to ADX. After the fixed data retention period passes, the TSI environment can be deleted, as ADX will contain the same data.
5050
1. Create ADX Cluster
5151
1. Set up parallel ingestion from hubs to ADX Cluster
5252
1. Continue ingesting data for the period of fixed retention
5353
1. Start using ADX Cluster
5454
1. Delete TSI environment
5555

56-
Detailed FAQ and engineering experience is outlined in [How to migrate TSI Gen1 to ADX](./how-to-tsi-gen1-migration.md)
56+
Detailed FAQ and engineering experience are outlined in [How to migrate TSI Gen1 to ADX](./how-to-tsi-gen1-migration.md)
5757

5858
### TSI Gen2
5959

60-
TSI Gen2 stores all data on cold storage using Parquet format as a blob in customer’s subscription. To migrate data customer, should take the blob and import it into ADX using bulk upload capability Lightingest. More information on lightingest can be fund here.
60+
TSI Gen2 stores all data on cold storage using Parquet format as a blob in the customer’s subscription. To migrate data, the customer should take the blob and import it into ADX using the bulk upload capability Lightingest. More information on lighting can be found here.
6161
1. Create ADX Cluster
6262
1. Redirect data ingestion to ADX Cluster
63-
1. Import TSI cold data using lightingest
63+
1. Import TSI cold data using lighting
6464
1. Start using ADX Cluster
6565
1. Delete TSI Environment
6666

67-
Detailed FAQ and engineering experience is outlined in [How to migrate TSI Gen2 to ADX](./how-to-tsi-gen2-migration.md)
67+
Detailed FAQ and engineering experience are outlined in [How to migrate TSI Gen2 to ADX](./how-to-tsi-gen2-migration.md)
6868

6969
> [!NOTE]
70-
> If you are unable to migrate to Time Series Insights to Azure Data Explorer by 31 March 2025, your Time Series Insights resources will be automatically deleted. You’ll be able to access Gen2 data in your storage account. However, you’ll only be able to perform management operations (such as updating storage account settings, getting storage account properties/keys, and deleting storage accounts) through Azure Resource Manager. For Gen1 data, if you have a support plan, please create a support ticket to retrieve your Gen1 data. We will keep your Gen1 data until 30 April 2025.
70+
> Your Time Series Insights resources will be automatically deleted if you cannot migrate from Time Series Insights to Azure Data Explorer by 7 July 2024. You’ll be able to access Gen2 data in your storage account. However, you can only perform management operations (such as updating storage account settings, getting storage account properties/keys, and deleting storage accounts) through Azure Resource Manager.

0 commit comments

Comments
 (0)