Add HDInsight relocation article

mumian · mumian · commit 1e94ad8d715a · 2025-05-02T10:49:45.000-04:00
diff --git a/articles/azure-resource-manager/management/relocation/relocation-hdinsight.md b/articles/azure-resource-manager/management/relocation/relocation-hdinsight.md
@@ -0,0 +1,102 @@
+---
+title: Relocate Azure Storage Account to another region
+description: Learn how to relocate Azure Storage Account to another region
+ms.date: 05/02/2025
+ms.topic: how-to
+ms.custom: subject-relocation, devx-track-azurepowershell
+---
+
+# Relocate Azure HDInsight to Another Region
+
+This article provides step-by-step guidance on relocating an Azure HDInsight cluster to a new region.
+
+## Prerequisites
+
+Before starting the relocation process, ensure the following prerequisites are met:
+
+- **Identify dependent resources**: Gather all Azure HDInsight-dependent resources. Depending on your deployment, the following resources may need to be deployed and configured in the target region before relocation:
+  - Compute (virtual machines)
+  - Azure SQL Database (metastore)
+  - [Storage Account or Data Lake Gen 2](./relocation-storage-account.md)
+  - [Azure Key Vault](./relocation-key-vault.md)
+  - Public IP address
+  - Private Endpoint
+  - [Azure Virtual Network](./relocation-virtual-network.md)
+  - Azure Active Directory, Azure Active Directory Domain, Managed Identity Services, Enterprise Security Package
+  - Azure DNS
+  - Quota availability in the target region ([request quota increase](../../../hdinsight/quota-increase-request.md)).
+
+- **Verify regional support**: Confirm that HDInsight and its dependent resources are supported in the target region.
+- **Prepare the target landing zone**: Ensure the target landing zone is ready and matches the assessed architecture.
+- **Document network settings**: Record network configurations, including firewalls and isolation settings.
+- **Identify metastore databases**: List all metastore databases configured in the source cluster.
+- **Review installed applications**: Document installed HDInsight applications and action scripts.
+- **Check availability zone support**: Verify that the target region supports availability zones. HDInsight clusters can currently be created using availability zones in the following regions:
+
+  | Americas           | Europe               | Africa              | Asia Pacific     |
+  |--------------------|----------------------|---------------------|------------------|
+  | Brazil South       | France Central       | South Africa North  | Australia East   |
+  | Canada Central     | Germany West Central |                     | Japan East       |
+  | Central US         | North Europe         |                     | Southeast Asia   |
+  | East US            | UK South             |                     |                  |
+  | East US 2          | West Europe          |                     |                  |
+  | South Central US   |                      |                     |                  |
+  | US Gov Virginia    |                      |                     |                  |
+  | West US 2          |                      |                     |                  |
+
+## Downtime Considerations
+
+Understand potential downtimes involved in the relocation process. For more details, see [Cloud Adoption Framework for Azure: Select a relocation method](/azure/cloud-adoption-framework/relocate/select#select-a-relocation-method).
+
+## Prepare for Relocation
+
+[jgao: it is not clear to me whehter the steps in this section take place before "Redeploy the Cluster".]
+### Export a Template
+
+Export an Azure Resource Manager (ARM) JSON template or a Bicep file for your HDInsight cluster. These templates define and automate the deployment of HDInsight clusters and their associated resources. Use one of the following methods to export the template:
+
+- [Export Bicep file using the Azure portal](../../bicep/export-bicep-portal.md)
+- [Export ARM template using the Azure portal](../../templates/export-template-portal.md)
+- [Export ARM template using Azure CLI](../../templates/export-template-cli.md)
+- [Export ARM template using Azure PowerShell](../../templates/export-template-powershell.md)
+
+### Modify the Template
+
+Update the exported Bicep file or ARM template to reflect the new region. Ensure all resource details, such as storage accounts, managed identities, user accounts (e.g., `sshuser`), network configurations, and metastore databases, are updated accordingly.
+
+### Relocate the Source Storage Account
+
+Relocate the source storage account to the target region. For detailed steps, see [Relocate storage account to another region](./relocation-storage-account.md).
+
+### Relocate Associated Jobs
+
+Relocate jobs associated with the HDInsight cluster to the target region. Follow the appropriate guidance based on your HDInsight implementation:
+
+- **Oozie pipeline/workflow**: Use the Hue import/export method. See [Migrate pipelines using Hue UI](https://gethue.com/exporting-and-importing-oozie-workflows/).
+- **Storm topology**: Transfer Storm event hub spout checkpoint information. See [Transfer Storm event hub spout checkpoint information](https://docs.microsoft.com/en-us/azure/hdinsight/storm/apache-troubleshoot-storm#how-do-i-transfer-storm-event-hub-spout-checkpoint-information-from-one-topology-to-another).
+- **HBase workload**: Use backup and replication. See [Backup and replication method](https://docs.microsoft.com/en-us/azure/hdinsight/hbase/apache-hbase-backup-replication).
+- **Hive workload & Interactive Query**: Follow the steps in [Migrate Azure HDInsight Hive workloads](../../../hdinsight/interactive-query/apache-hive-migrate-workloads#steps-to-upgrade).
+- **Kafka workload**: Use Mirror Maker. See [Mirror Maker](../../../hdinsight/kafka/apache-kafka-mirroring).
+
+### Sync Data
+
+Perform delta data synchronization from the source storage to the target storage using Azure Data Factory (ADF) or another defined data migration plan.
+
+## Redeploy the Cluster
+
+Deploy the updated Bicep file or ARM template to create the HDInsight cluster in the target region.
+
+## Validate the Relocation
+
+After relocation, validate the HDInsight cluster and its dependent resources. Perform smoke and integration tests to ensure all configurations are correct and data is accessible.
+
+## Clean Up
+
+(Optional) Discard or clean up resources in the source region if they are no longer needed.
+
+## Next Steps
+
+For more information on moving resources and disaster recovery in Azure, see:
+
+- [Move resources to a new resource group or subscription](../move-resource-group-and-subscription.md)
+- [Move Azure VMs to another region](../../../site-recovery/azure-to-azure-tutorial-migrate.md)
diff --git a/articles/azure-resource-manager/management/toc.yml b/articles/azure-resource-manager/management/toc.yml
@@ -83,112 +83,114 @@
             href: /azure/search/search-howto-move-across-regions?toc=/azure/azure-resource-manager/management/toc.json
         - name: Analytics
           items:
-          - name: Azure Event Hubs
+          - name: Event Hubs
             href: ./relocation/relocation-event-hub.md
-          - name: Azure Event Hubs Cluster
+          - name: Event Hubs Cluster
             href: ./relocation/relocation-event-hub-cluster.md
-          - name: Azure Stream Analytics
+          - name: HDInsight
+            href: ./relocation/relocation-hdinsight.md
+          - name: Power BI
+            href: /power-bi/admin/service-admin-region-move?toc=/azure/azure-resource-manager/management/toc.json
+          - name: Stream Analytics
             items:
             - name: Move Stream Analytics jobs
               href: ../../stream-analytics/copy-job.md?toc=/azure/azure-resource-manager/management/toc.json
             - name: Move Stream Analytics cluster
               href: ../../stream-analytics/move-cluster.md?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Power BI
-            href: /power-bi/admin/service-admin-region-move?toc=/azure/azure-resource-manager/management/toc.json
         - name: Compute
           items:
-          - name: Azure App Service
+          - name: App Service
             href: ./relocation/relocation-app-service.md
-          - name: Azure Batch
+          - name: Batch
             href: ../../batch/account-move.md?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Azure Functions
+          - name: Functions
             href: ./relocation/relocation-functions.md
-          - name: Azure Static Web Apps
+          - name: Static Web Apps
             href: ./relocation/relocation-static-web-apps.md
-          - name: Azure Virtual Machines
+          - name: Virtual Machines
             items:
-            - name: Move Azure VMs to another region
+            - name: Move VMs to another region
               href: ../../resource-mover/tutorial-move-region-virtual-machines.md?toc=/azure/azure-resource-manager/management/toc.json
-            - name: Move encrypted Azure VMs to another region
+            - name: Move encrypted VMs to another region
               href: ../../resource-mover/tutorial-move-region-encrypted-virtual-machines.md?toc=/azure/azure-resource-manager/management/toc.json
           - name: Virtual Machine Scale Sets
             href: ./relocation/relocation-virtual-machine-scale-sets.md
         - name: Containers
           items:
-          - name: Azure Container Registry
+          - name: Container Registry
             href: ./relocation/relocation-container-registry.md
-          - name: Azure Kubernetes Service
+          - name: Kubernetes Service
             href: ./relocation/relocation-kubernetes-service.md
         - name: Databases
           items:
-          - name: Azure Cache for Redis
+          - name: Cache for Redis
             href: ../../azure-cache-for-redis/cache-moving-resources.md?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Azure Cosmos DB
+          - name: Cosmos DB
             href: ./relocation/relocation-cosmos-db.md
-          - name: Azure Database for MariaDB Server
+          - name: Database for MariaDB Server
             href: /azure/mariadb/howto-move-regions-portal?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Azure Database for MySQL Server
+          - name: Database for MySQL Server
             href: /azure/mysql/howto-move-regions-portal?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Azure Database for PostgreSQL
+          - name: Database for PostgreSQL
             href: ./relocation/relocation-postgresql-flexible-server.md
         - name: Integration
           items:
-          - name: Azure Logic apps
+          - name: Logic apps
             href: ../../logic-apps/move-logic-app-resources.md?toc=/azure/azure-resource-manager/management/toc.json
         - name: Internet of Things
           items:
-          - name: Azure Event Grid
+          - name: Event Grid
             items:
-            - name: Relocate Azure Event Grid domains
+            - name: Relocate Event Grid domains
               href: ./relocation/relocation-event-grid-domains.md
-            - name: Relocate Azure Event Grid custom topics
+            - name: Relocate Event Grid custom topics
               href: ./relocation/relocation-event-grid-custom-topics.md
-            - name: Relocate Azure Event Grid system topics
+            - name: Relocate Event Grid system topics
               href: ./relocation/relocation-event-grid-system-topics.md
-          - name: Azure IoT Hub
+          - name: IoT Hub
             href: ../../iot-hub/iot-hub-how-to-clone.md?toc=/azure/azure-resource-manager/management/toc.json
         - name: Management and governance
           items:
-          - name: Azure Automation
+          - name: Automation
             href: ./relocation/relocation-automation.md
-          - name: Azure Backup
+          - name: Backup
             href: ./relocation/relocation-backup.md
-          - name: Azure Monitor - Log Analytics Workspace
+          - name: Monitor - Log Analytics Workspace
             href: ./relocation/relocation-log-analytics.md    
-          - name: Azure Site Recovery (Recovery Services vaults)
+          - name: Site Recovery (Recovery Services vaults)
             href: ./relocation/relocation-site-recovery.md  
         - name: Networking
           items:
-          - name: Azure App Gateway and Web App Firewall
-            displayname: Azure Application Gateway, Web Application Firewall
+          - name: App Gateway and Web App Firewall
+            displayname: Application Gateway, Web Application Firewall
             href: ./relocation/relocation-app-gateway.md
-          - name: Azure Load Balancer
+          - name: Load Balancer
             href: ../../load-balancer/move-across-regions-external-load-balancer-portal.md?toc=/azure/azure-resource-manager/management/toc.json
-          - name: Azure Private Link Service
+          - name: Private Link Service
             href: ./relocation/relocation-private-link.md 
-          - name: Azure Virtual Network
+          - name: Virtual Network
             items:
             - name: Virtual Network
               href: ./relocation/relocation-virtual-network.md 
             - name: Network Security Groups (NSG)
               href: ./relocation/relocation-virtual-network-nsg.md
         - name: Security
           items:
-          - name: Azure Firewall
+          - name: Firewall
             href: ./relocation/relocation-firewall.md
-          - name: Azure Key Vault
+          - name: Key Vault
             href: ./relocation/relocation-key-vault.md
           - name: Managed identities for Azure resources
             href: /entra/identity/managed-identities-azure-resources/how-to-managed-identity-regional-move?toc=/azure/azure-resource-manager/management/toc.json&bc=/azure/operational-excellence/breadcrumb/toc.json
         - name: Storage
           items:
-          - name: Azure NetApp Files
+          - name: NetApp Files
             href: ./relocation/relocation-netapp.md
-          - name: Azure Storage Account
+          - name: Storage Account
             href: ./relocation/relocation-storage-account.md
         - name: Web
           items:
-          - name: Azure API Management
+          - name: API Management
             href: ../../api-management/api-management-howto-migrate.md?toc=/azure/azure-resource-manager/management/toc.json
   - name: Tags
     items:
