You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/cyclecloud/how-to/ccws/plan-your-deployment.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,7 +18,7 @@ When doing a deployment, the Azure user account used need to be granted the foll
18
18
- Optional: permission to register a Microsoft Entra application
19
19
20
20
> [!NOTE]
21
-
> Recommendation is to predeploy a [Hub VNet](/azure/architecture/networking/architecture/hub-spoke) to connect to your enterprise network if one isn't already established. This hub can accommodate a [VPN Gateway](/azure/vpn-gateway/tutorial-create-gateway-portal) and an Azure Bastion. The CycleCloud Workspace for Slurm environment will be a spoke and peered during deployment.
21
+
> Recommendation is to predeploy a [Hub virtual network](/azure/architecture/networking/architecture/hub-spoke) to connect to your enterprise network if one isn't already established. This hub can accommodate a [VPN Gateway](/azure/vpn-gateway/tutorial-create-gateway-portal) and an Azure Bastion. The CycleCloud Workspace for Slurm environment will be a spoke and peered during deployment.
22
22
> Contact Azure HPC Support if VPN or Azure Bastion don't meet your requirements or are blocked by your organization
23
23
24
24
## Greenfield Deployment
@@ -35,19 +35,19 @@ In a greenfield deployment, the following resources and role assignments are cre
35
35
- Optionally a NAT gateway named `ccw-nat-gateway` and public IP `pip-ccw-nat-gateway`.
36
36
- Optionally an Azure NetApp Files account, pool, and volume with subnet `hpc-anf-subnet`.
37
37
- Optionally an Azure Managed Lustre Filesystem with subnet `ccw-lustre-subnet`.
38
-
- Optionally a VNET Peering.
38
+
- Optionally a virtual network Peering.
39
39
- Optionally a Private Endpoint to an existing Azure Database for MySQL flexible server instance.
40
40
41
41
## Brownfield Deployment
42
42
43
43
In a brownfield deployment, you can provide existing resources for:
44
-
- The VNET and subnets in which the environment is deployed.
44
+
- The virtual network and subnets in which the environment is deployed.
45
45
- Filesystem Storage for the user's home directories and/or other filers, such as external NFS mount points or Azure Managed Lustre Filesystem (AMLS).
46
46
- An Azure Database for MySQL flexible server instance for Slurm Job Accounting.
47
47
- A registered Microsoft Entra ID application for Open OnDemand authentication.
48
48
- A User-Assigned Managed Identity used by the registered Microsoft Entra ID application for the federated credentials.
49
49
50
-
If you're bringing your own VNET, follow these prerequisites:
50
+
If you're bringing your own virtual network, follow these prerequisites:
51
51
- A /29 **cyclecloud** subnet for the CycleCloud VM.
52
52
- A **compute** subnet for the nodes, where the scheduler, login, and compute nodes are created.
53
53
- When using Azure NetApp Files, a dedicated **netapp** subnet with the `Microsoft.NetApp/volumes` delegation as documented here [Azure NetApp Files](/azure/azure-netapp-files/azure-netapp-files-introduction).
Copy file name to clipboardExpand all lines: articles/cyclecloud/qs-deploy-ccws.md
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -84,15 +84,15 @@ Specify here if you want to create a new Virtual Network and subnets or use an e
84
84
- Select the CIDR that corresponds to the number of compute nodes you're targeting and specify a base IP address.
85
85
- Creating a Bastion is recommended if direct connectivity isn't provided by your corporate IT.
86
86
- Creating a NAT Gateway is required to provide outbound connectivity to internet.
87
-
- Peer to an existing Virtual Network if you already have a HUB that can deliver services like Bastion and a VPN gateway. Ensure that you select a base IP address compatible with your peered VNET. If the peered VNET has a gateway, check the **Allow** gateway transit option.
87
+
- Peer to an existing Virtual Network if you already have a HUB that can deliver services like Bastion and a VPN gateway. Ensure that you select a base IP address compatible with your peered virtual network. If the peered virtual network has a gateway, check the **Allow** gateway transit option.
88
88
89
89
#### Use existing Virtual Network
90
90
91
91
Before using an existing virtual network, check for the prerequisites in [Plan your CycleCloud Workspace for Slurm Deployment.](./how-to/ccws/plan-your-deployment.md#brownfield-deployment)
92
92
93
93
:::image type="content" source="./images/ccws/marketplace-networking-002.png" alt-text="Screenshot of the Networking options for using an existing one.":::
94
94
95
-
Please specify how to manage the registration of the private endpoint used for the storage account created to store CycleCloud projects with a private DNS zone. Options include creating a new private DNS zone, using an existing one, or not registering it.
95
+
Specify how to manage the registration of the private endpoint used for the storage account created to store CycleCloud projects with a private DNS zone. Options include creating a new private DNS zone, using an existing one, or not registering it.
96
96
97
97
:::image type="content" source="./images/ccws/marketplace-networking-003.png" alt-text="Screenshot of the Networking options for Private DNS zone.":::
98
98
@@ -120,18 +120,18 @@ You can postpone the start of the cluster if you need additional configuration t
120
120
121
121
To enable Slurm Job Accounting, check the box to display connectivity options. Ensure you have an Azure Database for MySQL flexible server resource that was deployed earlier.
122
122
123
-
You can connect using an FQDN or private IP if you supply your own virtual network or use VNET peering when creating a new virtual network as part of your deployment. Connection via private endpoint is also available if you choose to create a new virtual network.
123
+
You can connect using an FQDN or private IP if you supply your own virtual network or use virtual network peering when creating a new virtual network as part of your deployment. Connection via private endpoint is also available if you choose to create a new virtual network.
124
124
125
125
:::image type="content" source="./images/ccws/marketplace-slurm-accounting-001.png" alt-text="Screenshot of the Slurm Setting options for job accounting database, direct FQDN.":::
126
126
127
127
:::image type="content" source="./images/ccws/marketplace-slurm-accounting-002.png" alt-text="Screenshot of the Slurm Setting options for job accounting database with Private Endpoint.":::
128
128
129
129
### Partition Settings
130
130
131
-
Azure CycleCloud Workspace for Slurm comes with 3 defined Slurm partitions:
132
-
- HTC: For embarrassingly parallel non-MPI jobs.
133
-
- HPC: For tightly coupled MPI jobs mostly using VM types with or without InfiniBand support.
134
-
- GPU: For MPI and non-MPI GPU jobs using VM types with or without InfiniBand support.
131
+
Azure CycleCloud Workspace for Slurm comes with three defined Slurm partitions:
132
+
- HTC: For embarrassingly parallel non-MPI jobs.
133
+
- HPC: For tightly coupled MPI jobs mostly using VM types with or without InfiniBand support.
134
+
- GPU: For MPI and non-MPI GPU jobs using VM types with or without InfiniBand support.
135
135
136
136
You can configure the image and the maximum number of nodes for each partition that CycleCloud dynamically provisions. Only the HTC partition allows the use of spot instances, as spot instances aren't suitable for HPC and GPU jobs.
0 commit comments