Skip to content

Commit 2d164ba

Browse files
authored
Merge pull request #300663 from MicrosoftDocs/main
Publish to live, Monday 4 AM PST, 6/2
2 parents a8a9449 + 458d2b1 commit 2d164ba

File tree

7 files changed

+85
-75
lines changed

7 files changed

+85
-75
lines changed

articles/storage-mover/agent-deploy.md

Lines changed: 18 additions & 20 deletions
Original file line numberDiff line numberDiff line change
@@ -5,21 +5,21 @@ author: stevenmatthew
55
ms.author: shaas
66
ms.service: azure-storage-mover
77
ms.topic: how-to
8-
ms.date: 07/19/2024
8+
ms.date: 05/29/2025
99
---
1010

1111
<!--
1212
!########################################################
13-
STATUS: IN REVIEW
13+
STATUS: COMPLETE
1414
1515
CONTENT: final
1616
1717
REVIEW Stephen/Fabian: COMPLETE
1818
REVIEW Engineering: not reviewed
19-
EDIT PASS: started
19+
EDIT PASS: COMPLETE
2020
2121
Initial doc score: 83
22-
Current doc score: 96 (2093 words and 10 false-positive issues)
22+
Current doc score: 94 (2110 words and 11 false-positive issues)
2323
2424
!########################################################
2525
-->
@@ -36,22 +36,20 @@ This article guides you through the steps necessary to successfully deploy a Sto
3636

3737
## Prerequisites
3838

39-
1. The below Storage Mover endpoints need to have access to https traffic
39+
1. The following Storage Mover and Arc endpoints must have access to HTTPS traffic:
4040
- `mcr.microsoft.com`
4141
- `<region>.agentgateway.prd.azsm.azure.com`
4242
- `evhns-sm-ur-prd-<region>.servicebus.windows.net`
43-
44-
Azure Arc related network endpoints:
45-
- *.his.arc.azure.com
46-
- *.guestconfiguration.azure.com
47-
- login.microsoftonline.com
48-
- pas.windows.net
49-
- management.azure.com
43+
- `*.his.arc.azure.com`
44+
- `*.guestconfiguration.azure.com`
45+
- `login.microsoftonline.com`
46+
- `pas.windows.net`
47+
- `management.azure.com`
5048

5149
2. A capable Windows Hyper-V or VMware host on which to run the agent VM.<br/> See the [Recommended compute and memory resources](#recommended-compute-and-memory-resources) section in this article for details about resource requirements for the agent VM.
5250

5351
> [!NOTE]
54-
> At present, Windows Hyper-V and VMware are the only supported virtualization environments for your agent VM. Other virtualization environments have not been tested and are not supported.
52+
> Currently, Windows Hyper-V and VMware are the only supported virtualization environments for your agent VM. Other virtualization environments aren't tested and are therefore not supported.
5553
5654
## Determine required resources for the VM
5755

@@ -80,7 +78,7 @@ You can get help with [creating a virtual switch for Hyper-V virtual machines](/
8078
**Number of items** *refers to the total number of files and folders in the source.*
8179

8280
> [!IMPORTANT]
83-
> While agent VMs below minimal specs may work for your migration, they may not perform optimally and are not supported.
81+
> While agent VMs below minimal specs might work for your migration, performance is suboptimal and therefore not supported.
8482
8583
The [Performance targets](performance-targets.md) article contains test results from different source namespaces and VM resources.
8684

@@ -96,11 +94,11 @@ Images for agent VMs are hosted on Microsoft Download Center as a zip file. Down
9694

9795
The following steps describe the process for creating a VM using Microsoft Hyper-V. Consult the VMware support website for detailed guidance on creating a VMware-based VM.
9896

99-
1. Create a new VM to host the agent. Open **Hyper-V Manager**. In the **Actions** pane, select **New** and **Virtual Machine...** to launch the **New Virtual Machine Wizard**.
97+
1. Create a new VM on which to host the agent. Open **Hyper-V Manager**. In the **Actions** pane, select **New** and **Virtual Machine...** to launch the **New Virtual Machine Wizard**.
10098

10199
:::image type="content" source="media/agent-deploy/agent-vm-create-sml.png" alt-text="Image showing how to launch the New Virtual Machine Wizard from within the Hyper-V Manager." lightbox="media/agent-deploy/agent-vm-create-lrg.png":::
102100

103-
1. Within the **Specify Name and Location** pane, specify values for the agent VM's **Name** and **Location** fields. The location should match the folder where the VHD is stored, if possible. Select **Next**.
101+
1. Within the **Specify Name and Location** pane, provide values for the agent VM's **Name** and **Location** fields. The location should match the folder where the VHD is stored, if possible. Select **Next**.
104102

105103
:::image type="content" source="media/agent-deploy/agent-name-select-sml.png" alt-text="Image showing the location of the Name and Location fields within the New Virtual Machine Wizard." lightbox="media/agent-deploy/agent-name-select-lrg.png":::
106104

@@ -109,7 +107,7 @@ The following steps describe the process for creating a VM using Microsoft Hyper
109107
:::image type="content" source="media/agent-deploy/agent-vm-generation-select-sml.png" lightbox="media/agent-deploy/agent-vm-generation-select-lrg.png" alt-text="Image showing the location of the VM Generation options within the New Virtual Machine Wizard.":::
110108

111109
> [!IMPORTANT]
112-
> Only *Generation 1* VMs are supported. This Linux image won't boot as a *Generation 2* VM.
110+
> Only *Generation 1* VMs are supported. This Linux image doesn't boot as a *Generation 2* VM.
113111
114112
1. If you haven't already, [determine the amount of memory you need for your VM](#determine-required-resources-for-the-vm). Enter this amount in the **Assign Memory** pane, noting that you need to enter the value in MiB. 1 GiB = 1024 MiB. Using the **Dynamic Memory** feature is fine.
115113

@@ -174,7 +172,7 @@ xdmsh> 4
174172
Select the option **4) Unregister**. You're prompted for confirmation.
175173

176174
> [!WARNING]
177-
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM is not supported. If you need a new agent you should register a new, previously unregistered agent VM. Do not reuse a previously unregistered agent VM.
175+
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM isn't supported. If you need a new agent you should register a new, previously unregistered agent VM. Don't reuse a previously unregistered agent VM.
178176
179177
# [Azure portal](#tab/azure-portal)
180178

@@ -185,7 +183,7 @@ You can unregister an agent in the Azure portal by navigating to your storage mo
185183
- Select **Unregister agent** and wait for the operation to complete.
186184

187185
> [!WARNING]
188-
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM is not supported. If you need a new agent, you must use a new agent image that was never registered before and register this new agent VM. Do not reuse a previously unregistered agent VM.
186+
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM isn't supported. If you need a new agent, you must use a new agent image that was never registered before and register this new agent VM. Don't reuse a previously unregistered agent VM.
189187
190188
# [PowerShell](#tab/powershell)
191189

@@ -199,7 +197,7 @@ Unregister-AzStorageMoverAgent -ResourceGroupName <YourResourceGroupName> -Stora
199197
*-Force* is an optional parameter, suppressing the confirmation prompt.
200198

201199
> [!WARNING]
202-
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM is not supported. If you need a new agent you should register a new, previously unregistered agent VM. Do not reuse a previously unregistered agent VM.
200+
> Unregistration stops any running migration job on the agent and permanently removes the agent from the pool of available migration agents. Re-registration of a previously registered agent VM isn't supported. If you need a new agent you should register a new, previously unregistered agent VM. Don't reuse a previously unregistered agent VM.
203201
204202
---
205203

articles/storage-mover/includes/protocol-endpoint-agent.md

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
author: stevenmatthew
33
ms.author: shaas
44
ms.topic: include
5-
ms.date: 06/02/2024
5+
ms.date: 05/29/2025
66
ms.service: azure-storage-mover
77
---
88
<!--
@@ -17,7 +17,8 @@ Handle file and content with care.
1717

1818
The current Azure Storage Mover release supports full-fidelity migrations for specific source-target pair combinations. Always utilize the latest agent version to benefit from these supported sources and destinations:
1919

20-
|Source protocol |Target |Comments |
21-
|------------------|--------------------------------|-----------------------------------------------------------------------|
22-
|SMB 2.x mount |Azure file share (SMB) |SMB 1.x sources and NFS Azure file shares are currently not supported. |
23-
|NFS 3 & 4 mount |Azure blob storage container |Containers with the "Hierarchical Namespace Service (HNS)" feature enabled, are supported and the ADLS Gen2 REST API set is used for migration.|
20+
|Source protocol |Target |Comments |
21+
|------------------|--------------------------------------------------------------|-----------------------------------------------------------------------|
22+
|SMB 2.x mount |Azure blob storage container, Azure file share (SMB) | SMB 1.x sources and NFS Azure file shares are currently not supported. |
23+
|SMB 2.x mount |Azure blob storage container | Containers with the Hierarchical Namespace Service (HNS) feature enabled are supported and the ADLS Gen2 REST API set is used for migration.|
24+
|NFS 3 & 4 mount |Azure blob storage container | Containers with the Hierarchical Namespace Service (HNS) feature enabled are supported and the ADLS Gen2 REST API set is used for migration.|
60.7 KB
Loading
9.43 KB
Loading

articles/storage-mover/performance-targets.md

Lines changed: 16 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -5,31 +5,31 @@ author: stevenmatthew
55
ms.author: shaas
66
ms.service: azure-storage-mover
77
ms.topic: conceptual
8-
ms.date: 08/07/2023
8+
ms.date: 05/29/2025
99
---
1010

1111
<!--
1212
!########################################################
13-
STATUS: IN REVIEW
13+
STATUS: COMPLETE
1414
15-
CONTENT: final
15+
CONTENT: COMPLETE
1616
17-
REVIEW Stephen/Fabian: not reviewed
17+
REVIEW Stephen/Fabian: REVIEWED
1818
REVIEW Engineering: not reviewed
1919
2020
Initial doc score: 83
21-
Current doc score: 93 (1201 words and 10 false-positive issues)
21+
Current doc score: 93 (1457 words and 7 false-positive issues)
2222
2323
!########################################################
2424
-->
2525

2626
# Azure Storage Mover scale and performance targets
2727

28-
The performance of a storage migration service is a key aspect for any migration. In this article, we share performance test results, though because Azure Storage Mover is a new service, your experience may vary.
28+
The performance of a storage migration service is a key aspect for any migration. In this article, we share performance test results, though because Azure Storage Mover is a new service, your experience might vary.
2929

3030
## Scale targets
3131

32-
Azure Storage Mover is tested with 100 million namespace items (files and folders), migrated from a [supported source to a supported target](service-overview.md#supported-sources-and-targets) in Azure.
32+
Azure Storage Mover is tested with 500 million namespace items (files and folders), migrated from a [supported source to a supported target](service-overview.md#supported-sources-and-targets) in Azure.
3333

3434
## How we test
3535

@@ -51,11 +51,11 @@ The following table describes the characteristics of the test environments that
5151

5252
|Test No. |No. of files |Total files weight |File size |Folder structure |
5353
|----------------|----------------|----------------------|-------------|---------------------------------------------------------------|
54-
|**1** |12 million |12 GB |1 KB each |12 folders, each with 100 sub-folders containing 10,000 files |
54+
|**1** |12 million |12 GB |1 KB each |12 folders, each with 100 subfolders containing 10,000 files |
5555
|**2** |30 |20 GB | |1 folder |
5656
|**3** |1 million |100 GB |100 KB each |1,000 folders, each with 1,000 files |
5757
|**4** |1 | |4 TB | |
58-
|**5** |117 million |117 GB |1 KB each |117 folders, each with 100 sub-folders containing 10,000 files |
58+
|**5** |117 million |117 GB |1 KB each |117 folders, each with 100 subfolders containing 10,000 files |
5959
|**6** |1 | |1 TB | |
6060
|**7** |3.3 million |45 GB |13 KB each |200,000 folders, each contains 16\17 files |
6161
|**8** |50 million |1 TB |20 KB each |2,940,000 folders, each contains 17 files |
@@ -110,7 +110,7 @@ The following table describes the characteristics of the test environment that p
110110
|Test | Result |
111111
|-------------------|-------------------------------------------------------------------------------------------------------------------------------|
112112
|Test namespace | 19% files 0 KiB - 1 KiB <br />57% files 1 KiB - 16 KiB <br />16% files 16 KiB - 1 MiB <br />6% folders |
113-
|Test source device | Linux server VM <br />16 virtual CPU cores<br />64-GiB RAM |
113+
|Test source device | Linux server virtual machine (VM) <br />16 virtual CPU cores<br />64-GiB RAM |
114114
|Test source share | NFS v3.0 share <br /> Warm cache: Data set in memory (baseline test). In real-world scenarios, add disk recall times. |
115115
|Network | Dedicated, over-provisioned configuration, negligible latency. No bottle neck between source - agent - target Azure storage. |
116116

@@ -119,7 +119,7 @@ Different agent resource configurations are tested on NFS endpoints:
119119
1. **Minspec: 4 CPU / 8 GB RAM**<br/>
120120
4 virtual CPU cores at 2.7 GHz each and 8 GiB of memory (RAM) is the minimum specification for an Azure Storage Mover agent.
121121

122-
|Test | Single file, 1 TiB|&tilde;3.3M files, &tilde;200 K folders, &tilde;45 GiB |&tilde;50M files, &tilde;3M folders, &tilde;1 TiB |
122+
|Test | Single file, 1 TiB|&tilde;3.3M files, &tilde;200-K folders, &tilde;45 GiB |&tilde;50M files, &tilde;3M folders, &tilde;1 TiB |
123123
|--------------------------|-------------------|------------------------------------------------------|--------------------------------------------------|
124124
|Elapsed time | 16 Min, 42 Sec | 15 Min, 18 Sec | 5 hr, 28 Min |
125125
|Items* per Second | - | 3548 | 2860 |
@@ -147,26 +147,26 @@ Different agent resource configurations are tested on NFS endpoints:
147147

148148
## Why migration performance varies
149149

150-
Fundamentally, network quality and the ability to process files, folders and their metadata impact your migration velocity.
150+
Fundamentally, network quality and the ability to process files, folders, and their metadata affect your migration velocity.
151151

152152
Across the two core areas of network and compute, several aspects have an impact:
153153

154154
- **Migration scenario** <br />Copying into an empty target is faster as compared to a target with content. This behavior is due the migration engine evaluating not only the source, but also the target to make copy decisions.
155155
- **Namespace item count** <br />Migrating 1 GiB of small files takes more time than migrating 1 GiB of larger files.
156156
- **Namespace shape** <br />A wide folder hierarchy lends itself to more parallel processing than a narrow or deep directory structure. The file to folder ratio also plays a roll.
157-
- **Namespace churn** <br />How many files, folders, and metadata have changed between two copy runs from the same source to the same target.
157+
- **Namespace churn** <br />How many files, folders, and metadata change between two copy runs from the same source to the same target.
158158
- **Network**
159159
- bandwidth and latency between source and migration agent
160160
- bandwidth and latency between migration agent and the target in Azure
161161
- **Migration agent resources** <br />The amount of memory (RAM), number of compute cores, and even the amount of available, local disk capacity on the migration agent can have a profound impact on the migration velocity. More compute resources help to optimize the utilization of the available bandwidth, especially when large amounts of smaller files need to be processed in a migration.
162162

163-
For example, a traditional migration requires a strategy to minimize downtime of the workload that depends on the storage that is to be migrated. Azure Storage Mover supports such a strategy. It's called convergent, n-pass migration.
163+
For example, a traditional migration requires a strategy to minimize downtime of the workload that depends on the storage that is to be migrated. Azure Storage Mover supports this strategy, referred to as *convergent, n-pass migration*.
164164

165-
In this strategy, you copy from source to target several times. During these copy iterations, the source remains available for read and write to the workload. Just before the final copy iteration, you take the source offline. It's expected that the final copy finishes faster than say the first copy you've ever made and takes about as long as the one immediately preceding it. After the final copy, the workload is failed over to use the new target storage in Azure and available for use again.
165+
In this strategy, you copy from source to target several times. During these copy iterations, the source remains available for read and write to the workload. Just before the final copy iteration, you take the source offline. The final copy is expected to finish faster than the first copy you make, and take about as long as the one immediately preceding it. After the final copy, the workload is failed over to use the new target storage in Azure and available for use again.
166166

167167
During the first copy from source to target, the target is likely empty and all the source content must travel to the target. As a result, the first copy is likely most constrained by the available network resources.
168168

169-
Towards the end of a migration, when you've copied the source to the target several times already, only a few files, folders, and metadata has changed since the last copy. In this last copy iteration, comparing each file in source and target to see if it needs to be updated, requires more compute resources and fewer network resources. Copy runs in this late stage of a migration are often more compute-constrained. Proper [resourcing of the Storage Mover agent](agent-deploy.md#recommended-compute-and-memory-resources) becomes increasingly important.
169+
Towards the end of a migration, after you copy the source to the target several times already, only a few files, folders, and metadata are modified following the last copy. In this last copy iteration, comparing each file in source and target to see if it needs to be updated, requires more compute resources and fewer network resources. Copy runs in this late stage of a migration are often more compute-constrained. Proper [resourcing of the Storage Mover agent](agent-deploy.md#recommended-compute-and-memory-resources) becomes increasingly important.
170170

171171
## Next steps
172172

0 commit comments

Comments
 (0)