You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: azure-managed-lustre/amlfs-overview.md
+19-13Lines changed: 19 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -4,7 +4,7 @@ description: Use Azure Managed Lustre to quickly create an Azure-based Lustre fi
4
4
ms.topic: overview
5
5
author: pauljewellmsft
6
6
ms.author: pauljewell
7
-
ms.date: 01/17/2025
7
+
ms.date: 02/03/2025
8
8
ms.reviewer: mayabishop
9
9
ms.custom: references_regions
10
10
@@ -15,15 +15,16 @@ ms.custom: references_regions
15
15
16
16
# What is Azure Managed Lustre?
17
17
18
-
The Azure Managed Lustre service gives you the capability to quickly create an Azure-based Lustre file system for cloud-based high-performance computing jobs.
18
+
Azure Managed Lustre is a managed file system that offers scalable, powerful, cost-effective storage for high-performance computing (HPC) workloads.
19
19
20
-
Lustre is an open-source parallel file system that can scale to massive storage sizes while also providing high performance throughput. Lustre is used by the world's fastest supercomputers and in data-centric workflows for many types of industries. For more information, see [https://www.lustre.org](https://www.lustre.org).
20
+
Here are some key features and benefits of Azure Managed Lustre:
21
21
22
-
Azure Managed Lustre saves you the work of provisioning, configuring, and managing your own Lustre file system. Using a **Create** command in the Azure portal, you can quickly deploy a Lustre file system in the size that you need, connect your clients, and be ready to use the system.
22
+
-**Accelerate HPC workloads**: Offers a high-performance distributed parallel file system solution, ideal for HPC workloads that require high throughput, low latency, and Lustre protocol compatibility.
23
+
-**Purpose-built managed service**: Provides the benefits of a Lustre parallel file system without the complexity of managing the underlying infrastructure. Azure Managed Lustre is a fully managed service that simplifies operations, reduces setup costs, and eliminates complex maintenance.
24
+
-**Azure Blob Storage integration**: Allows you to connect Azure Managed Lustre file systems with Azure Blob Storage containers for optimal data placement and cost management. For more information, see [Azure Blob Storage integration](#azure-blob-storage-integration).
25
+
-**Azure Kubernetes Service (AKS) integration**: Allows you to containerize workloads using the available AKS-compatible CSI driver. For more information, see [Use Azure Managed Lustre with Kubernetes](#use-azure-managed-lustre-with-kubernetes).
23
26
24
-
Microsoft Azure Blob Storage is integrated with Azure Managed Lustre, which allows you to specify files to import from a blob container for the file system's use. When the high-performance computing jobs are finished, you can export changed data to Azure Blob Storage, and delete the Azure Managed Lustre system. For more information, see [Azure Blob Storage integration](#azure-blob-storage-integration), later in this article.
25
-
26
-
You can also use your Azure Managed Lustre file system with your Azure Kubernetes Service (AKS) containers. For more information, see [Use Azure Managed Lustre with Kubernetes](#use-azure-managed-lustre-with-kubernetes).
27
+
Lustre is an open-source parallel file system that can scale to massive storage sizes while also providing high-performance throughput. Lustre is used by the world's fastest supercomputers and in data-centric workflows for many types of industries. For more information about Lustre, see [https://www.lustre.org](https://www.lustre.org).
27
28
28
29
## Data security in Azure Managed Lustre
29
30
@@ -38,20 +39,22 @@ All information in an Azure Managed Lustre file system is protected by virtual m
38
39
39
40
Your Azure Managed Lustre file system uses Azure managed disks as object storage target (OST) data disks.
40
41
41
-
All Azure Managed Lustre file systems that are created as a "durable" file system type use Azure Premium SSD (solidstate drive) disks configured as locally redundant storage (LRS). LRS disk contents are replicated three times within the local data center to protect against drive and server rack failures.
42
+
All Azure Managed Lustre file systems that are created as a "durable" file system type use Azure Premium SSD (solid-state drive) disks configured as locally redundant storage (LRS). LRS disk contents are replicated three times within the local data center to protect against drive and server rack failures.
42
43
43
44
The Azure Managed Lustre file system itself also contributes to data resilience through the object storage processes it uses to store data on these disks.
44
45
45
46
If you need regional or global data redundancy, you can integrate your file system with Azure Blob Storage. Once integrated, you can initiate an export job to export files to an Azure Blob Storage container with a different redundancy policy for long-term storage. Configure Azure Blob Storage redundancy for the storage account. You can choose zonal data redundancy (ZRS) or global data redundancy (GRS) when you create the storage account. To learn more about data redundancy options for your Azure Managed Lustre files, see [Supported storage account types](amlfs-prerequisites.md#supported-storage-account-types).
46
47
47
48
## Azure Blob Storage integration
48
49
49
-
Microsoft Azure Blob Storage is integrated with Azure Managed Lustre, which allows you to specify files to import from a blob container for the file system's use. Azure Blob Storage integration is an application of Lustre hierarchical storage management (HSM). There's no need to import your entire data set for every job. Instead, you can create a different file system for different jobs and store data in lower-cost Azure blob containers between uses. When the high-performance computing jobs are finished, you can export changed data to Azure Blob Storage, and delete the Azure Managed Lustre system.
50
+
Azure Blob Storage is integrated with Azure Managed Lustre, which allows you to specify files to import from a blob container for the file system's use. Azure Blob Storage integration is an application of Lustre hierarchical storage management (HSM). There's no need to import your entire data set for every job. Instead, you can create a different file system for different jobs and store data in lower-cost Azure blob containers between uses. When the high-performance computing jobs are finished, you can export changed data to Azure Blob Storage, and delete the Azure Managed Lustre system.
50
51
51
-
Azure Managed Lustre is customized to work seamlessly with Azure Blob Storage. You can specify an existing blob container to make its existing data accessible from your Azure Managed Lustre file system, or specify an empty container that you populate with data or use to store your output. Setup and maintenance are done for you. You just specify which blob container to use.
52
+
Azure Managed Lustre is customized to work seamlessly with Azure Blob Storage. You can specify an existing blob container to make its existing data accessible from your Azure Managed Lustre file system. You can also specify an empty container that you populate with data or use to store your output. Setup and maintenance are done for you. You just specify which blob container to use.
52
53
53
54
If you integrate Azure Blob Storage when you create a Lustre file system, you can use Lustre HSM features. If you don't want the benefits of Lustre HSM, you can import and export data for the Azure Managed Lustre file system by using client commands directly.
54
55
56
+
To learn more about this feature, see [Azure Blob Storage integration](blob-integration.md).
57
+
55
58
## Use Azure Managed Lustre with Kubernetes
56
59
57
60
If you want to use an Azure Managed Lustre storage system with your Kubernetes containers, you can use the Azure Lustre container support interface (CSI) driver for Kubernetes, which is compatible with Azure Kubernetes Service (AKS). Other types of Kubernetes installation aren't currently supported.
@@ -64,9 +67,12 @@ Kubernetes can simplify configuring and deploying virtual client endpoints for y
64
67
65
68
The Azure Lustre CSI driver for Kubernetes can automate installing the client software and mounting drives. The driver provides a CSI controller plugin as a deployment with two replicas by default, and a CSI node plugin, as a DaemonSet. You can change the number of replicas.
66
69
70
+
To learn more about this feature, see [Use the Azure Managed Lustre CSI driver with Azure Kubernetes Service](use-csi-driver-kubernetes.md).
71
+
67
72
To find out which driver versions to use, see [Compatible Kubernetes versions](use-csi-driver-kubernetes.md#compatible-kubernetes-versions).
68
73
69
-
## Next steps
74
+
## Related content
70
75
71
-
- Learn more about [blob storage integration](blob-integration.md)
72
-
- Learn more about [using Azure Managed Lustre with Kubernetes](use-csi-driver-kubernetes.md)
76
+
- Deploy an Azure Managed Lustre file system using [Azure portal](create-file-system-portal.md), [Azure Resource Manager (ARM) templates](create-file-system-resource-manager.md), or [Terraform](create-aml-file-system-terraform.md).
77
+
- Learn more about [Blob Storage integration](blob-integration.md)
78
+
- Learn more about using [Azure Managed Lustre with Kubernetes](use-csi-driver-kubernetes.md)
0 commit comments