You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/storage/file-sync/file-sync-cloud-tiering-overview.md
+13-4Lines changed: 13 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,10 +1,10 @@
1
1
---
2
-
title: Understand Azure File Sync cloud tiering
2
+
title: Understand Azure File Sync Cloud Tiering
3
3
description: Understand cloud tiering, an optional Azure File Sync feature. Frequently accessed files are cached locally on the server; others are tiered to Azure Files.
4
4
author: khdownie
5
5
ms.service: azure-file-storage
6
6
ms.topic: concept-article
7
-
ms.date: 04/13/2023
7
+
ms.date: 07/16/2025
8
8
ms.author: kendownie
9
9
# Customer intent: As a system administrator, I want to understand how Azure File Sync cloud tiering works so that I can optimize local storage use and manage file access efficiently in my organization.
10
10
---
@@ -13,12 +13,14 @@ ms.author: kendownie
13
13
14
14
Cloud tiering, an optional feature of Azure File Sync, decreases the amount of local storage required while keeping the performance of an on-premises file server.
15
15
16
-
When enabled, this feature stores only frequently accessed (hot) files on your local server. Infrequently accessed (cool) files are split into namespace (file and folder structure) and file content. The namespace is stored locally and the file content stored in an Azure file share in the cloud.
16
+
When enabled, this feature stores only frequently accessed (hot) files on your local server. Infrequently accessed (cool) files are split into namespace (file and folder structure) and file content. The namespace is stored locally, and the file content is stored in an Azure file share in the cloud.
17
17
18
18
When a user opens a tiered file, Azure File Sync seamlessly recalls the file data from the Azure file share.
19
19
20
20
## How cloud tiering works
21
21
22
+
Cloud tiering works by monitoring file access patterns and tiering files based on defined policies.
23
+
22
24
### Cloud tiering policies
23
25
24
26
When you enable cloud tiering, there are two policies that you can set to inform Azure File Sync when to tier cool files: the **volume free space policy** and the **date policy**.
@@ -50,7 +52,11 @@ Typically, last access time is tracked and available. However, when a new server
50
52
The date policy works the same way. Without a last access time, the date policy will act on the last modified time. If that's unavailable, it will fall back to the create time of a file. Over time, the system will observe more file access requests and automatically start to use the self-tracked last access time.
51
53
52
54
> [!NOTE]
53
-
> Cloud tiering does not depend on the NTFS feature for tracking last access time. This NTFS feature is off by default and due to performance considerations, we don't recommend that you manually enable this feature. Cloud tiering tracks last access time separately.
55
+
> Cloud tiering doesn't depend on the NTFS feature for tracking last access time. This NTFS feature is off by default. Due to performance considerations, we don't recommend that you manually enable this feature. Cloud tiering tracks last access time separately.
56
+
57
+
### Considerations for choosing a cloud tiering policy
58
+
59
+
Cold files that are less frequently accessed are best suited to be tiered files, as recalling data requires downloading from the cloud. Azure File Sync reserves 10% of total memory for persisting recalls to the disk. If 60% of this reserved memory is in use, the recalls won't be persisted to the disk. If a large number of tiered files are present on the system and a lot of access takes place, the system might hit a memory threshold. This can cause unexpected additional egress, I/O performance degradation, system slowness, and hangs.
54
60
55
61
### Proactive recalling
56
62
@@ -86,6 +92,7 @@ It's also possible for a file to be partially tiered or partially recalled. In a
86
92
> Size represents the logical size of the file. Size on disk represents the physical size of the file stream that's stored on the disk.
87
93
88
94
## Low disk space mode
95
+
89
96
Disks that have server endpoints can run out of space due to various reasons, even when cloud tiering is enabled. These reasons include:
90
97
91
98
- Data being manually copied to the disk outside of the server endpoint path
@@ -107,7 +114,9 @@ When the volume free space surpasses the threshold, Azure File Sync reverts to t
107
114
If a volume has two server endpoints, one with tiering enabled and one without tiering, then low disk space mode will only apply to the server endpoint where tiering is enabled.
108
115
109
116
### How is the threshold for low disk space mode calculated?
117
+
110
118
Calculate the threshold by taking the minimum of the following three numbers:
Copy file name to clipboardExpand all lines: articles/storage/file-sync/file-sync-server-endpoint-create.md
+21-20Lines changed: 21 additions & 20 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,12 +1,12 @@
1
1
---
2
-
title: Create an Azure File Sync server endpoint
2
+
title: Create an Azure File Sync Server Endpoint
3
3
description: Understand the options during server endpoint creation and how to best apply them to your situation.
4
4
author: khdownie
5
5
ms.service: azure-file-storage
6
6
ms.topic: how-to
7
-
ms.date: 05/08/2024
7
+
ms.date: 07/16/2025
8
8
ms.author: kendownie
9
-
# Customer intent: As an IT admin deploying Azure File Sync, I want to create a server endpoint, so that I can synchronize files between my registered server and Azure cloud storage effectively.
9
+
# Customer intent: As an IT admin deploying Azure File Sync, I want to create a server endpoint, so that I can synchronize files between my registered server and Azure cloud storage.
10
10
---
11
11
12
12
# Create an Azure File Sync server endpoint
@@ -58,10 +58,10 @@ There are two fundamentally different initial sync behaviors:
58
58
:::column:::
59
59
Merge is the standard option and selected by default. You should leave the selection on **Merge** unless for certain migration scenarios.
60
60
* When joining a server location, in most scenarios either the server location or the cloud share is empty. In these cases, **Merge** is the right behavior and will lead to expected results.
61
-
* When both locations contain files and folders, the namespaces will merge. If there are files or folder names on the server that also exist in the cloud share, there will be a sync conflict. [Conflicts are automatically resolved](../files/storage-files-faq.md#afs-conflict-resolution). </br> </br> Within the **Merge** option, there is a selection to be made for how content from the Azure file share will initially arrive on the server. This selection has no impact if the Azure file share is empty. You can find more details in the upcoming paragraph: [Initial download](#initial-download-section)
61
+
* When both locations contain files and folders, the namespaces will merge. If there are files or folder names on the server that also exist in the cloud share, there will be a sync conflict. [Conflicts are automatically resolved](../files/storage-files-faq.md#afs-conflict-resolution). </br> </br> Within the **Merge** option, you can select how content from the Azure file share will initially arrive on the server. This selection has no impact if the Azure file share is empty. You can find more details in the [Initial download section](#initial-download-section).
62
62
:::column-end:::
63
63
:::column:::
64
-
**Authoritative upload** is an initial sync option reserved for a specific migration scenario. Syncing the same server path that was also used to seed the cloud share with for instance Azure Data Box. In this case, the cloud and the server locations have mostly the same data but the server is slightly newer. Users kept making changes while Data Box was in transport. This migration scenario then calls for updating the cloud seamlessly with the changes on the server (newer) without producing any conflicts. So the server is the authority of the shape of the namespace and Data Box was used to avoid large-scale initial upload from the server. Server authoritative upload enables a zero-downtime adoption of the cloud, even when an offline data transport mechanism was used to seed the cloud storage.
64
+
**Authoritative upload** is an initial sync option reserved for a specific migration scenario. It syncs the same server path that was also used to seed the cloud share with for instance Azure Data Box. In this case, the cloud and the server locations have mostly the same data, but the server is slightly newer. Users kept making changes while Data Box was in transport. This migration scenario then calls for updating the cloud seamlessly with the changes on the server (newer) without producing any conflicts. So the server is the authority of the shape of the namespace and Data Box was used to avoid large-scale initial upload from the server. Server authoritative upload enables a zero-downtime adoption of the cloud, even when an offline data transport mechanism was used to seed the cloud storage.
65
65
:::column-end:::
66
66
:::row-end:::
67
67
@@ -79,20 +79,20 @@ The **Initial download** section is available for the second and any more server
79
79
> [!NOTE]
80
80
> Selecting an initial download option has no impact if the Azure file share is empty.
81
81
82
-
As part of this section, a choice can be made for how content from the Azure file share will initially arrive on the server:
82
+
As part of this section, you choose how content from the Azure file share will initially arrive on the server.
83
83
84
-
:::row:::
85
-
:::column:::
86
-
:::image type="content" source="media/file-sync-server-endpoint-create/initial-download-options.png" alt-text="An image describing the options in the create server endpoint Azure portal wizard." lightbox="media/file-sync-server-endpoint-create/initial-download-options-expanded.png":::
87
-
:::column-end:::
88
-
:::column:::
89
-
***Namespace only** </br> Will bring only the file and folder structure from the Azure file share to the local server. None of the file content is downloaded. This option is the default if you previously enabled cloud tiering for this new server endpoint.
90
-
***Namespace first, then content** </br> For a faster availability of the data, your namespace is brought down first, independent of your cloud tiering setting. Once the namespace is available on the server, the file content is then recalled from the cloud to the server. Recall happens based on the last-modified timestamp on each file. If the free space on server volume is less than 10%, the remaining files will remain tiered files. This option is the default if you didn't turn on cloud tiering for this server endpoint.
91
-
***Avoid tiered files** </br> This option will download each file in its entirety before the file shows up in the folder on server. This option avoids a tiered file to ever exist on the server. A namespace item and file content are always present at the same time. Avoid this option if fast disaster recovery from the cloud is your reason for creating a server endpoint. If you have applications that require full files to be present and can't tolerate tiered files in their namespace, this is ideal. This option isn't available if you're using cloud tiering for your new server endpoint.
92
-
:::column-end:::
93
-
:::row-end:::
84
+
:::image type="content" source="media/file-sync-server-endpoint-create/initial-download-options.png" alt-text="An image describing the options in the create server endpoint Azure portal wizard." lightbox="media/file-sync-server-endpoint-create/initial-download-options-expanded.png":::
94
85
95
-
Once you select an initial download option, you can't change it after you confirm to create the server endpoint.
86
+
|| Download the namespace first | Download the namespace only | Avoid tiered files |
|**Description**| Downloads the entire namespace first. File content is recalled from the cloud as a background activity to the server based on the heat map, which recalls recent accessed data sooner. If the free space on server volume is less than 10%, the remaining files will remain tiered files. | Only the namespace (file and folder structure) is downloaded. No file content is brought to the server. | Downloads each file in its entirety before the file shows up in the folder on server. This option avoids a tiered file to ever exist on the server. A namespace item and file content are always present at the same time. |
89
+
|**Default settings**| Default if cloud tiering isn't enabled for this server endpoint. | Default if cloud tiering is enabled for this server endpoint. | Not selected as a default option. This option is only available when cloud tiering isn't enabled. |
90
+
|**Behavior when tiering is enabled**| When cloud tiering is enabled, the background recall of the tiered files will stop as soon as it meets the criteria for the specified cloud tiering policy (respects volume free policy and date policy too, if present). | Only the namespace (file and folder structure) is downloaded. No file content is brought to the server. | Option not available. |
91
+
|**Behavior when tiering isn't enabled**| When cloud tiering isn't enabled, the intent is to recall all the data to the server endpoint via background recall. You would need to provision a volume that is large enough to accommodate all of the data. If the volume doesn't have enough free space, some files will be left as tiered even when cloud tiering is disabled. | Only the namespace (file and folder structure) is downloaded. No file content is brought to the server. | Downloads each file in its entirety before the file shows up in the folder on server. |
92
+
| **When to use** | <ul><li>When users need quick access to recent files soon after the namespace is downloaded, and most data is present in the Azure file share at provisioning time. Customers with low bandwidth may also benefit from the background recall after initial provisioning. For more details on recalling tiered files, see [How to manage Azure File Sync tiered files](file-sync-how-to-manage-tiered-files.md#how-to-recall-a-tiered-file-to-disk).</li><li>Best suited for Azure File Sync server-side disaster recovery scenarios where server path starts out as empty folder, for example a new server endpoint in branch office.</li></ul> | Ideal for applications that need to recall data less often or only small amount of data on-demand. | <ul><li>When all data must always be available locally without relying on tiering.</li><li>Ideal for applications requiring access to all the files at all times.</li><li>Useful in low bandwidth servers where we do not want tiered files for data access performance issues.</li></ul> |
93
+
|**Implications**| The CPU/memory should be sized based on the namespace scale and resource needs to avoid I/O performance issues. For details, see [Recommended System Resources for Azure File Sync](file-sync-planning.md#recommended-system-resources)| - | <ul><li>Volume should have enough space to store all the data. Initial download will likely take much longer due to the need for downloading all file content.</li><li>Not suitable for fast disaster recovery as this is slower than the first two options.</li></ul> |
94
+
95
+
After you select an initial download option, you can't change it after you confirm to create the server endpoint.
96
96
97
97
> [!NOTE]
98
98
> When adding a server endpoint and files exist in the Azure file share, if you choose to download the namespace first, files will show up as tiered until they're downloaded locally. Files are downloaded using a single thread by default to limit network bandwidth usage. To improve the file download performance, use the [Invoke-StorageSyncFileRecall](file-sync-how-to-manage-tiered-files.md#how-to-recall-a-tiered-file-to-disk) cmdlet with a thread count greater than 1.
@@ -119,16 +119,17 @@ Currently, provisioning steps are only displayed when the new server endpoint be
119
119
#### Provisioning status
120
120
121
121
Here are the different statuses that are displayed when server endpoint provisioning is in progress and what they mean:
122
-
* In progress: SEP isn't ready for user access.
122
+
123
+
* In progress: The server endpoint isn't ready for user access.
123
124
* Ready (sync not functional): Users can access data, but changes won't sync to cloud file share.
124
-
* Ready (sync functional): Users can access data and changes will be synced to the cloud share making the endpoint fully functional.
125
+
* Ready (sync functional): Users can access data and changes will be synced to the cloud share, making the endpoint fully functional.
125
126
* Failed: Provisioning failed because of an error.
126
127
127
128
The provisioning steps tab is only visible in the Azure portal for supported scenarios. It won't be available or visible for unsupported scenarios.
128
129
129
130
## Next steps
130
131
131
-
There's more to discover about Azure file shares and Azure File Sync. The following articles will help you understand advanced options and best practices. They also provide help with troubleshooting. These articles contain links to the [Azure file share documentation](../files/storage-files-introduction.md) where appropriate.
132
+
There's more to discover about Azure file shares and Azure File Sync. The following articles will help you understand advanced options, best practices, and troubleshooting.
0 commit comments