You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: azure-managed-lustre/auto-export.md
+9-9Lines changed: 9 additions & 9 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,11 +12,11 @@ ms.reviewer: brianl
12
12
---
13
13
# Azure Managed Lustre Auto-Export (Preview)
14
14
15
-
The Auto-Export feature for Azure Managed Lustre is a capability that automatically synchronizes changes in your Azure Managed Lustre file system with a linked Azure Blob Storage Container. This feature ensures that new and modified files in the file system are reflected in the associated Blob Storage Container without manual intervention, streamlining data management and improving synchronization for long-term storage.
15
+
The Auto-Export feature for Azure Managed Lustre is a capability that automatically synchronizes changes in your Azure Managed Lustre file system with a linked Azure Blob Storage Container. This feature ensures that new and modified files in the file system are reflected in the associated Blob Storage Container without manual intervention. This streamlines data management and improves synchronization for long-term storage.
16
16
17
17
## How auto-export works
18
18
19
-
Auto-Export operates by continuously monitoring changes in the Azure Managed Lustre file system. Based on the configured export policy, it updates the contents of the associated Blob Storage Container to reflect these changes. This provides users with a seamless and automated data replication process.
19
+
Auto-Export operates by continuously monitoring changes in the Azure Managed Lustre file system. Based on the configured export policy, it updates the contents of the associated Blob Storage Container to reflect these changes. This feature provides users with a seamless and automated data replication process.
20
20
21
21
### Configuration
22
22
@@ -29,7 +29,7 @@ To create a new Auto-Export job, follow these steps:
29
29
1. In the **Job Type** dropdown, select **Auto-Export**.
30
30
1. In the **File system path** field, you can enter a string to specify a directory path. All new or changed files in the file system under this path (prefix) are continually exported. Files are written to the blob container with the same file path (or prefix) that they have in the Lustre system. To avoid overwriting existing files in the blob container, ensure that the path of the file in your Lustre system doesn't overlap with the existing path of the file in the blob container unless your Lustre file was imported from that path in the Blob Container.
31
31
32
-
:::image type="content" source="media/auto-export/auto-export-create-job.png" alt-text="Screenshot of the Blob integration page for Azure Managed Lustre highlighting the Create new job button and showing Create import/export job on the right." lightbox="media/auto-export/auto-export-create-job.png":::
32
+
:::image type="content" source="media/auto-export/auto-export-create-job.png" alt-text="Screenshot of the Blob integration page for Azure Managed Lustre showing Create import/export job." lightbox="media/auto-export/auto-export-create-job.png":::
33
33
34
34
### Auto-Export Behavior
35
35
@@ -40,7 +40,7 @@ Auto-Export handles different types of changes as follows:
40
40
-**Deletion**: When files, directories, or symlinks are deleted in the file system, they are **not removed** from the Blob Storage Container.
41
41
42
42
No more than one Blob Integration job (Manual Export, Auto Export, Import) can be run at a time.
43
-
Auto-Export is implemented as continuous export iterations. Upon completion of an iteration, Blob Integration will scan the filesystem for any new files, directories, or content changes and start a new iteration of an export job.
43
+
Auto-Export is implemented as continuous export iterations. Upon completion of an iteration, Blob Integration scans the filesystem for any new files, directories, or content changes and start a new iteration of an export job.
44
44
Logs created in your configured Logging container can help identify synchronization issues and understand the reasons behind failed operations.
45
45
46
46
## Monitoring and Managing Auto-Export
@@ -51,15 +51,15 @@ The Blob Integration pane displays details of export activities in the **Recent
51
51
52
52
To cancel the job that's in progress, select the **Cancel** link for that job in the **Recent jobs** table. The **Cancel** link is only available for the current auto-export.
53
53
54
-
To view the metrics of an Auto-Export job, click on the **Name** of the job, and the **Metrics blade**will appear on the right-hand side panel in the Portal.
54
+
To view the metrics of an Auto-Export job, click on the **Name** of the job, and the **Metrics blade**appears on the side panel in the Portal.
55
55
56
-
:::image type="content" source="media/auto-export/auto-export-job-details.png" alt-text="Screenshot of the Blob integration page for Azure Managed Lustre highlighting an auto-export job name and showing Job details on the right." lightbox="media/auto-export/auto-export-job-details.png":::
56
+
:::image type="content" source="media/auto-export/auto-export-job-details.png" alt-text="Screenshot of the Blob integration page for Azure Managed Lustre showing Job details." lightbox="media/auto-export/auto-export-job-details.png":::
57
57
58
58
### Auto-Export Job Monitoring
59
59
60
60
The Blob Integration pane displays details of export activities in the **Recent jobs** section, including the status of recent jobs and metrics related to automatic synchronization.
61
61
To cancel the job that's in progress, select the **Cancel** link for that job in the **Recent jobs** table. The **Cancel** link is only available for the current auto-export.
62
-
To view the metrics of an Auto-Export job, click on the **Name** of the job, and the **Metrics blade**will appear on the right-hand side panel in the Portal.
62
+
To view the metrics of an Auto-Export job, click on the **Name** of the job, and the **Metrics blade**appears on the side panel in the Portal.
63
63
64
64
### Metrics
65
65
@@ -154,14 +154,14 @@ Metrics are grouped into two main categories, *Overall* and *Current Iteration*.
154
154
Total number of files that failed to copy during the current iteration. Click on this link to be taken to the Logging Container page to view the logs associated with this Auto-Export job.
155
155
:::column-end:::
156
156
:::row-end:::
157
-
\* The metrics for the current ongoing iteration should be read as “so far.” For example, Files Discovered is the number of the files discovered for exporting at the moment of reporting. The next stats reporting cycle may show that more files have been discovered.
157
+
\* The metrics for the current ongoing iteration should be read as “so far.” For example, Files Discovered is the number of the files discovered for exporting at the moment of reporting. The next stats reporting cycle may show that more files are discovered.
158
158
159
159
## Considerations and Best Practices
160
160
161
161
While using Auto-Export, consider the following best practices to ensure smooth operation:
162
162
163
163
-**Conflict Management**: If a file is modified in both the file system and Blob Storage, there is a risk of overwrite. Use application-level coordination to prevent conflicting edits.
164
-
-**Disable Auto-Export Before Deletion**: Before deleting a file system or its Blob Integration, ensure that all queued updates have been synchronized. Verify that the **Last Successful Iteration Time** is recent and the **Files Failed** metric is zero to avoid data loss. Then, disable Auto-Export.
164
+
-**Disable Auto-Export Before Deletion**: Before deleting a file system or its Blob Integration, ensure that all queued updates are synchronized. Verify that the **Last Successful Iteration Time** is recent and the **Files Failed** metric is zero to avoid data loss. Then, disable Auto-Export.
0 commit comments