Skip to content

Commit 28856a0

Browse files
committed
Update set up GPU lab for freshness
1 parent 29519db commit 28856a0

File tree

1 file changed

+66
-47
lines changed

1 file changed

+66
-47
lines changed
Lines changed: 66 additions & 47 deletions
Original file line numberDiff line numberDiff line change
@@ -1,113 +1,134 @@
11
---
2-
title: Set up a lab with GPUs in Azure Lab Services | Microsoft Docs
3-
description: Learn how to set up a lab with graphics processing unit (GPU) virtual machines.
4-
author: nicolela
5-
ms.topic: how-to
6-
ms.date: 06/09/2022
2+
title: Set up a lab with GPUs
3+
titleSuffix: Azure Lab Services
4+
description: Learn how to set up a lab in Azure Lab Services with graphics processing unit (GPU) virtual machines.
5+
services: lab-services
76
ms.service: lab-services
7+
author: ntrogh
8+
ms.author: nicktrog
9+
ms.topic: how-to
10+
ms.date: 04/24/2023
811
---
912

10-
# Set up a lab with GPU virtual machines
13+
# Set up a lab with GPU virtual machines in Azure Lab Services
1114

1215
[!INCLUDE [preview note](./includes/lab-services-new-update-focused-article.md)]
1316

14-
This article shows you how to do the following tasks:
15-
16-
- Choose between *visualization* and *compute* graphics processing units (GPUs).
17-
- Ensure that the appropriate GPU drivers are installed.
17+
In this article, you learn how to choose between the different GPU-based virtual machines sizes when creating a lab in Azure Lab Services. Learn how to install the necessary drivers in the lab to take advantage of the GPUs.
1818

1919
## Choose between visualization and compute GPU sizes
2020

21-
On the first page of the lab creation wizard, in the **Virtual machine size** drop-down list, you select the size of the VMs that are needed for your class.
21+
When you create a lab in Azure Lab Services, you have to select a virtual machine size. Choose the right virtual machine size, based on the usage scenario or [class type](./class-types.md).
22+
23+
:::image type="content" source="./media/how-to-setup-gpu/lab-gpu-selection.png" alt-text="Screenshot of the New lab window for creating a new lab in the Lab Services website, highlighting the VM sizes dropdown.":::
24+
25+
Azure Lab Services has two GPU-based virtual machines size categories:
26+
27+
- Compute GPUs
28+
- Visualization GPUs
2229

23-
![Screenshot of the "New lab" pane for selecting a VM size](./media/how-to-setup-gpu/lab-gpu-selection.png)
30+
> [!NOTE]
31+
> You may not see some of these VM sizes in the list when you create a lab. The list of VM sizes is based on the capacity assigned to your Microsoft-managed Azure subscription. For more information about capacity, see [Capacity limits in Azure Lab Services](../lab-services/capacity-limits.md). For availability of VM sizes, see [Products available by region](https://azure.microsoft.com/regions/services/?products=virtual-machines).
2432
25-
In this process, you have the option of selecting either **Visualization** or **Compute** GPUs. It's important to choose the type of GPU that's based on the software that your students will use.
33+
### Compute GPU sizes
2634

27-
As described in the following table, the *compute* GPU size is intended for compute-intensive applications. For example, the [Deep Learning in Natural Language Processing class type](./class-type-deep-learning-natural-language-processing.md) uses the **Small GPU (Compute)** size. The compute GPU is suitable for this type of class, because students use deep learning frameworks and tools that are provided by the [Data Science Virtual Machine image](https://azuremarketplace.microsoft.com/en-us/marketplace/apps?search=Data%20science%20Virtual%20machine&page=1&filters=microsoft%3Blinux) to train deep learning models with large sets of data.
35+
The *compute* GPU size is intended for compute-intensive applications. For example, the [Deep Learning in Natural Language Processing class type](./class-type-deep-learning-natural-language-processing.md) uses the **Small GPU (Compute)** size. The compute GPU is suitable for this type of class, because lab users apply deep learning frameworks and tools that are provided by the [Data Science Virtual Machine image](https://azuremarketplace.microsoft.com/en-us/marketplace/apps?search=Data%20science%20Virtual%20machine&page=1&filters=microsoft%3Blinux) to train deep learning models with large sets of data.
2836

2937
| Size | vCPUs | RAM | Description |
3038
| ---- | ----- | --- | ----------- |
3139
| Small GPU (Compute) | 6 vCPUs | 112 GB RAM | [Standard_NC6s_v3](../virtual-machines/ncv3-series.md). This size supports both Windows and Linux and is best suited for compute-intensive applications such as artificial intelligence (AI) and deep learning. |
3240

33-
The *visualization* GPU sizes are intended for graphics-intensive applications. For example, the [SOLIDWORKS engineering class type](./class-type-solidworks.md) shows using the **Small GPU (Visualization)** size. The visualization GPU is suitable for this type of class, because students interact with the SOLIDWORKS 3D computer-aided design (CAD) environment for modeling and visualizing solid objects.
41+
### Visualization GPU sizes
42+
43+
The *visualization* GPU sizes are intended for graphics-intensive applications. For example, the [SOLIDWORKS engineering class type](./class-type-solidworks.md) shows using the **Small GPU (Visualization)** size. The visualization GPU is suitable for this type of class, because lab users interact with the SOLIDWORKS 3D computer-aided design (CAD) environment for modeling and visualizing solid objects.
3444

3545
| Size | vCPUs | RAM | Description |
3646
| ---- | ----- | --- | ----------- |
3747
| Small GPU (Visualization) | 8 vCPUs | 28 GB RAM | [Standard_NV8as_v4](../virtual-machines/nvv4-series.md). This size is best suited for remote visualization, streaming, gaming, and encoding that use frameworks such as OpenGL and DirectX. Currently, this size supports Windows only. |
3848
| Medium GPU (Visualization) | 12 vCPUs | 112 GB RAM | [Standard_NV12s_v3](../virtual-machines/nvv3-series.md). This size supports both Windows and Linux. It's best suited for remote visualization, streaming, gaming, and encoding that use frameworks such as OpenGL and DirectX. |
3949

40-
> [!NOTE]
41-
> You may not see some of these VM sizes in the list when creating a lab. This list is populated based on the capacity assigned to your Microsoft-managed Azure subscription. For more information about capacity, see [Capacity limits in Azure Lab Services](../lab-services/capacity-limits.md). For availability of VM sizes, see [Products available by region](https://azure.microsoft.com/regions/services/?products=virtual-machines).
42-
4350
## Ensure that the appropriate GPU drivers are installed
4451

4552
To take advantage of the GPU capabilities of your lab VMs, ensure that the appropriate GPU drivers are installed. In the lab creation wizard, when you select a GPU VM size, you can select the **Install GPU drivers** option. This option is enabled by default.
4653

47-
![Screenshot of the "New lab" showing the "Install GPU drivers" option](./media/how-to-setup-gpu/lab-gpu-drivers.png)
54+
:::image type="content" source="./media/how-to-setup-gpu/lab-gpu-drivers.png" alt-text="Screenshot of the New lab page in the Lab Services website, highlighting the Install GPU drivers" option.:::
4855

49-
Selecting **Install GPU drivers** ensures that recently released drivers are installed for the type of GPU and image that you selected.
56+
When you select **Install GPU drivers**, it ensures that recently released drivers are installed for the type of GPU and image that you selected.
5057

5158
- When you select the Small GPU *(Compute)* size, your lab VMs are powered by the [NVIDIA Tesla V100 GPU](https://www.nvidia.com/en-us/data-center/v100/) GPU. In this case, recent Compute Unified Device Architecture (CUDA) drivers are installed, which enables high-performance computing.
52-
- When you select the Small GPU *(Visualization)* size, your lab VMs are powered by the [AMD Raedon Instinct MI25 Accelerator GPU](https://www.amd.com/en/products/professional-graphics/instinct-mi25). In this case, recent AMD GPU drivers are installed, which enables the use of graphics-intensive applications.
59+
- When you select the Small GPU *(Visualization)* size, your lab VMs are powered by the [AMD Radeon Instinct MI25 Accelerator GPU](https://www.amd.com/en/products/professional-graphics/instinct-mi25). In this case, recent AMD GPU drivers are installed, which enables the use of graphics-intensive applications.
5360
- When you select the Medium GPU *(Visualization)* size, your lab VMs are powered by the [NVIDIA Tesla M60](https://images.nvidia.com/content/tesla/pdf/188417-Tesla-M60-DS-A4-fnl-Web.pdf) GPU and [GRID technology](https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/NVIDIA_GRID_vPC_Solution_Overview.pdf). In this case, recent GRID drivers are installed, which enables the use of graphics-intensive applications.
5461

5562
> [!IMPORTANT]
56-
> The **Install GPU drivers** option only installs the drivers when they aren't present on your lab's image. For example, NVIDIA GPU drivers are already installed on the Azure marketplace's [Data Science image](../machine-learning/data-science-virtual-machine/overview.md#whats-included-on-the-dsvm). If you create a Small GPU (Compute) lab using the Data Science image and choose to **Install GPU drivers**, the drivers won't be updated to a more recent version. To update the drivers, you will need to manually install them as explained in the next section.
63+
> The **Install GPU drivers** option only installs the drivers when they aren't present on your lab's image. For example, NVIDIA GPU drivers are already installed on the Azure marketplace's [Data Science Virtual Machine image](../machine-learning/data-science-virtual-machine/overview.md#whats-included-on-the-dsvm). If you create a Small GPU (Compute) lab using the Data Science image and choose to **Install GPU drivers**, the drivers won't be updated to a more recent version. To update the drivers, you will need to manually install the drivers.
5764
58-
### Install the drivers manually
65+
### Install GPU drivers manually
5966

6067
You might need to install a different version of the drivers than the version that Azure Lab Services installs for you. This section shows how to manually install the appropriate drivers.
6168

6269
#### Install the Small GPU (Compute) drivers
6370

6471
To manually install drivers for the Small GPU *(Compute)* size, follow these steps:
6572

66-
1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
73+
1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
6774

68-
1. After your lab is created, connect to the template VM to install the appropriate drivers. Read [NVIDIA Tesla (CUDA) drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-tesla-cuda-drivers) for more information about specific driver versions that are recommended depending on the Windows OS version being used. Otherwise, follow the below steps to install the latest NVIDIA drivers:
75+
1. After your lab is created, connect to the template VM to install the appropriate drivers.
6976

70-
![Screenshot of the NVIDIA Driver Downloads page](./media/how-to-setup-gpu/nvidia-driver-download.png)
77+
- Follow the detailed installation steps in [NVIDIA Tesla (CUDA) drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-tesla-cuda-drivers) for more information about specific driver versions that are recommended depending on the Windows OS version being used.
7178

72-
Otherwise, follow the below steps to install the latest NVIDIA drivers:
79+
:::image type="content" source="./media/how-to-setup-gpu/nvidia-driver-download.png" alt-text="Screenshot of the NVIDIA Driver Downloads page":::
7380

74-
a. In a browser, go to the [NVIDIA Driver Downloads page](https://www.nvidia.com/Download/index.aspx).
75-
b. Set the **Product Type** to **Tesla**.
76-
c. Set the **Product Series** to **V-Series**.
77-
d. Set the **Operating System** according to the type of base image you selected when you created your lab.
78-
e. Set the **CUDA Toolkit** to the version of CUDA driver that you need.
79-
f. Select **Search** to look for your drivers.
80-
g. Select **Download** to download the installer.
81-
h. Run the installer so that the drivers are installed on the template VM.
81+
- Alternately, follow these steps to install the latest NVIDIA drivers:
82+
1. Go to the [NVIDIA Driver Downloads page](https://www.nvidia.com/Download/index.aspx).
83+
1. Set the **Product Type** to **Tesla**.
84+
1. Set the **Product Series** to **V-Series**.
85+
1. Set the **Operating System** according to the type of base image you selected when you created your lab.
86+
1. Set the **CUDA Toolkit** to the version of CUDA driver that you need.
87+
1. Select **Search** to look for your drivers.
88+
1. Select **Download** to download the installer.
89+
1. Run the installer so that the drivers are installed on the template VM.
8290

8391
1. Validate that the drivers are installed correctly by following instructions in the [Validate the installed drivers](how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
84-
1. After you've installed the drivers and other software that is required for your class, select **Publish** to create your students' VMs.
92+
93+
1. After you've installed the drivers and other software that is required for your class, select **Publish** to create the lab virtual machines.
8594

8695
> [!NOTE]
8796
> If you're using a Linux image, after you've downloaded the installer, install the drivers by following the instructions in [Install CUDA drivers on Linux](../virtual-machines/linux/n-series-driver-setup.md?toc=%2fazure%2fvirtual-machines%2flinux%2ftoc.json#install-cuda-drivers-on-n-series-vms).
8897
8998
#### Install the Small GPU (Visualization) drivers
9099

91-
To manually install drivers for the Small GPU *(visualization)* size, doing the following steps:
100+
To manually install drivers for the Small GPU *(visualization)* size, follow these steps:
101+
102+
1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
92103

93-
1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
94104
1. After your lab is created, connect to the template VM to install the appropriate drivers.
95-
1. Install the AMD drivers template VM by following instructions in the [Install AMD GPU drivers on N-series VMs running Windows](../virtual-machines/windows/n-series-amd-driver-setup.md) article.
105+
106+
1. Install the AMD drivers template VM by following the instructions in [Install AMD GPU drivers on N-series VMs running Windows](../virtual-machines/windows/n-series-amd-driver-setup.md).
107+
96108
1. Restart the template VM.
109+
97110
1. Validate that the drivers are installed correctly by following the instructions in the [Validate the installed drivers](./how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
98-
1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your students' VMs.
111+
112+
1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your lab virtual machines.
99113

100114
#### Install the Medium GPU (Visualization) drivers
101115

102-
1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
116+
To manually install drivers for the Medium GPU *(visualization)* size, follow these steps:
117+
118+
1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting.
119+
103120
1. After your lab is created, connect to the template VM to install the appropriate drivers.
121+
104122
1. Install the GRID drivers that are provided by Microsoft on the template VM by following the instructions for your operating system:
123+
105124
- [Windows NVIDIA GRID drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-grid-drivers)
106125
- [Linux NVIDIA GRID drivers](../virtual-machines/linux/n-series-driver-setup.md?toc=%2fazure%2fvirtual-machines%2flinux%2ftoc.json#nvidia-grid-drivers)
107126

108127
1. Restart the template VM.
128+
109129
1. Validate that the drivers are installed correctly by following the instructions in the [Validate the installed drivers](how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
110-
1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your students' VMs.
130+
131+
1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your lab virtual machines.
111132

112133
### Validate the installed drivers
113134

@@ -142,8 +163,6 @@ To verify driver installation for Linux images, see [verify driver installation
142163

143164
## Next steps
144165

145-
See the following articles:
146-
147-
- As an administrator, [create and manage labs](how-to-manage-labs.md).
148-
- As an educator, create a class using [SOLIDWORKS computer-aided design (CAD)](class-type-solidworks.md) software.
149-
- As an educator, create a class using [MATLAB (matrix laboratory)](class-type-matlab.md) software.
166+
- Learn how to [create and manage labs](how-to-manage-labs.md).
167+
- Create a lab with the [SOLIDWORKS computer-aided design (CAD)](class-type-solidworks.md) software.
168+
- Create a lab with the [MATLAB (matrix laboratory)](class-type-matlab.md) software.

0 commit comments

Comments
 (0)