Skip to content

Commit 8f6b2d7

Browse files
authored
Merge e548ec0 into 80167fb
2 parents 80167fb + e548ec0 commit 8f6b2d7

File tree

1 file changed

+142
-0
lines changed

1 file changed

+142
-0
lines changed
Lines changed: 142 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,142 @@
1+
# Demonstration: Deploying Azure Resources for an ML Platform
2+
3+
Costa Rica
4+
5+
[![GitHub](https://img.shields.io/badge/--181717?logo=github&logoColor=ffffff)](https://github.com/)
6+
[brown9804](https://github.com/brown9804)
7+
8+
Last updated: 2025-04-29
9+
10+
------------------------------------------
11+
12+
> This repository contains Terraform configurations for setting up an Azure Machine Learning workspace along with compute clusters and supportive resources to form the core of an ML platform.
13+
> `Remember, managing your infrastructure through code (IaC) not only ensures consistency, but also offers version control, reproducibility, and collaboration benefits—essential for scalable ML operations.`
14+
> For additional Terraform templates covering various Azure services, check out [this repository](https://github.com/MicrosoftCloudEssentials-LearningHub/AzureTerraformTemplates-v0.0.0). Explore and borrow ideas as needed!
15+
16+
> [!TIP]
17+
> **About Infrastructure via Terraform**: Terraform is a powerful IaC tool that enables you to define and provision your cloud resources through a high-level configuration language. This approach keeps not only your application objects under source control but also the infrastructure code, ensuring reproducible environments across development, testing, and production. Microsoft also offers additional IaC tools like Bicep and ARM templates, giving you flexibility in how you manage your Azure resources.
18+
19+
<p align="center">
20+
<img width="550" alt="Azure Machine Learning architecture" src="https://github.com/user-attachments/assets/your-aml-architecture-placeholder">
21+
</p>
22+
23+
<details>
24+
<summary><b>List of References </b> (Click to expand)</summary>
25+
26+
- [Azure Machine Learning Documentation](https://learn.microsoft.com/en-us/azure/machine-learning/)
27+
- [Terraform Azure Provider Documentation](https://registry.terraform.io/providers/hashicorp/azurerm/latest/docs)
28+
- [Azure Terraform Templates](https://github.com/MicrosoftCloudEssentials-LearningHub/AzureTerraformTemplates-v0.0.0)
29+
</details>
30+
31+
<details>
32+
<summary><b>Table of Contents </b> (Click to expand)</summary>
33+
34+
- [Overview](#overview)
35+
- [Configuring Access with Azure CLI](#configuring-access-with-azure-cli)
36+
- [Configure Remote Storage for Terraform Deployment](#configure-remote-storage-for-terraform-deployment)
37+
- [How to Execute the Deployment](#how-to-execute-the-deployment)
38+
</details>
39+
40+
## Overview
41+
42+
```plaintext
43+
.
44+
├── README.md
45+
├── src
46+
│ ├── main.tf
47+
│ ├── variables.tf
48+
│ ├── provider.tf
49+
│ ├── terraform.tfvars
50+
│ ├── remote-storage.tf
51+
│ └── outputs.tf
52+
```
53+
54+
- **main.tf** *(Main Terraform configuration file)*: Contains the core infrastructure code that provisions your Azure Machine Learning workspace, compute clusters, and other related services.
55+
- **variables.tf** *(Variable definitions)*: Defines variables to parameterize your configurations. This includes settings for workspace names, compute configurations, and other environment-specific parameters.
56+
- **provider.tf** *(Provider configurations)*: Specifies the necessary settings for the Azure provider so Terraform can authenticate and manage your Azure resources.
57+
- **terraform.tfvars** *(Variable values)*: Holds the actual values for the variables defined in `variables.tf`. Adjust these values according to the environment you’re targeting (development, staging, production).
58+
- **remote-storage.tf** *(Remote state storage configuration)*: Configures a remote backend (such as Azure Blob Storage) for storing Terraform’s state file securely, ensuring reliable collaboration.
59+
- **outputs.tf** *(Output values)*: Defines outputs to display resource endpoints, IDs, and other key details after a successful deployment.
60+
61+
## Configuring Access with Azure CLI
62+
63+
> To deploy Azure Machine Learning resources, proper authentication is required. In many cases, you might need to assign a service principal with the appropriate permissions.
64+
65+
To list available service principals, run:
66+
67+
```sh
68+
az ad sp list --query "[].{Name:displayName, AppId:appId, ObjectId:id}" --output table
69+
```
70+
71+
Below is an example showing how you would reference the service principal (whose Object ID you’ve retrieved) in your Terraform configuration:
72+
73+
```hcl
74+
ml_service_principal_id = "12345678-1234-1234-1234-1234567890ab"
75+
```
76+
77+
## Configure Remote Storage for Terraform Deployment
78+
79+
> For robust state management and collaboration, configuring a remote backend for Terraform is essential. This section outlines how to use Azure Blob Storage for remote state storage.
80+
81+
1. **Create an Azure Storage Account**:
82+
- Use the Azure portal or CLI to set up a new storage account if you do not already have one.
83+
- Note down the storage account name and access key.
84+
2. **Create a Storage Container**:
85+
- Within your storage account, create a container dedicated to holding your Terraform state file.
86+
3. **Configure Terraform Backend**:
87+
- In the `remote-storage.tf` file (located in the `src` folder), include the backend configuration to connect to your Azure Blob Storage container.
88+
89+
## How to Execute the Deployment
90+
91+
```mermaid
92+
graph TD;
93+
A[az login] --> B(terraform init)
94+
B --> C{Terraform Provisioning Stage}
95+
C -->|Review| D[terraform plan]
96+
C -->|Deploy Resources| E[terraform apply]
97+
C -->|Tear Down Infrastructure| F[terraform destroy]
98+
```
99+
100+
> [!IMPORTANT]
101+
> Before executing, update `terraform.tfvars` with your personalized configuration values. This repository provisions an Azure Machine Learning workspace, compute clusters,
102+
> and essential support resources for running ML experiments. A video walk-through is available that clearly explains the deployment steps. <br/>
103+
> *Note: Once your ML experiments are complete, remember to scale down compute clusters or delete the resource group to control costs.*
104+
105+
1. **Login to Azure**: Navigate to your Terraform directory and log in to your Azure account. This command opens a browser window for authentication.
106+
107+
```sh
108+
cd ./infrastructure/azMachineLearning/src/
109+
```
110+
```sh
111+
az login
112+
```
113+
114+
https://github.com/user-attachments/assets/aad4e0e6-46bb-457d-a768-0eedf6a9d2ba
115+
116+
117+
2. **Initialize Terraform**: Set up your working directory and install the necessary provider plugins.
118+
```sh
119+
terraform init
120+
```
121+
122+
https://github.com/user-attachments/assets/e56ed69c-7a82-48fd-ba72-bbd9f862175d
123+
124+
3. **Review the Deployment Plan**: Preview the changes Terraform will make.
125+
```sh
126+
terraform plan -var-file terraform.tfvars
127+
```
128+
129+
4. **Apply the Configuration**: Deploy the specified Azure resources.
130+
```sh
131+
terraform apply -var-file terraform.tfvars
132+
```
133+
134+
5. **Destroy the Infrastructure (if needed)**: Clean up resources by tearing down the deployment.
135+
```sh
136+
terraform destroy -var-file terraform.tfvars
137+
```
138+
139+
<div align="center">
140+
<h3 style="color: #4CAF50;">Total Visitors</h3>
141+
<img src="https://profile-counter.glitch.me/brown9804/count.svg" alt="Visitor Count" style="border: 2px solid #4CAF50; border-radius: 5px; padding: 5px;"/>
142+
</div>

0 commit comments

Comments
 (0)