|
1 | 1 | ---
|
2 |
| -title: Set up a lab with GPUs in Azure Lab Services | Microsoft Docs |
3 |
| -description: Learn how to set up a lab with graphics processing unit (GPU) virtual machines. |
4 |
| -author: nicolela |
5 |
| -ms.topic: how-to |
6 |
| -ms.date: 06/09/2022 |
| 2 | +title: Set up a lab with GPUs |
| 3 | +titleSuffix: Azure Lab Services |
| 4 | +description: Learn how to set up a lab in Azure Lab Services with graphics processing unit (GPU) virtual machines. |
| 5 | +services: lab-services |
7 | 6 | ms.service: lab-services
|
| 7 | +author: ntrogh |
| 8 | +ms.author: nicktrog |
| 9 | +ms.topic: how-to |
| 10 | +ms.date: 04/24/2023 |
8 | 11 | ---
|
9 | 12 |
|
10 |
| -# Set up a lab with GPU virtual machines |
| 13 | +# Set up a lab with GPU virtual machines in Azure Lab Services |
11 | 14 |
|
12 | 15 | [!INCLUDE [preview note](./includes/lab-services-new-update-focused-article.md)]
|
13 | 16 |
|
14 |
| -This article shows you how to do the following tasks: |
15 |
| - |
16 |
| -- Choose between *visualization* and *compute* graphics processing units (GPUs). |
17 |
| -- Ensure that the appropriate GPU drivers are installed. |
| 17 | +In this article, you learn how to choose between the different GPU-based virtual machines sizes when creating a lab in Azure Lab Services. Learn how to install the necessary drivers in the lab to take advantage of the GPUs. |
18 | 18 |
|
19 | 19 | ## Choose between visualization and compute GPU sizes
|
20 | 20 |
|
21 |
| -On the first page of the lab creation wizard, in the **Virtual machine size** drop-down list, you select the size of the VMs that are needed for your class. |
| 21 | +When you create a lab in Azure Lab Services, you have to select a virtual machine size. Choose the right virtual machine size, based on the usage scenario or [class type](./class-types.md). |
| 22 | + |
| 23 | +:::image type="content" source="./media/how-to-setup-gpu/lab-gpu-selection.png" alt-text="Screenshot of the New lab window for creating a new lab in the Lab Services website, highlighting the VM sizes dropdown."::: |
| 24 | + |
| 25 | +Azure Lab Services has two GPU-based virtual machines size categories: |
| 26 | + |
| 27 | +- Compute GPUs |
| 28 | +- Visualization GPUs |
22 | 29 |
|
23 |
| - |
| 30 | +> [!NOTE] |
| 31 | +> You may not see some of these VM sizes in the list when you create a lab. The list of VM sizes is based on the capacity assigned to your Microsoft-managed Azure subscription. For more information about capacity, see [Capacity limits in Azure Lab Services](../lab-services/capacity-limits.md). For availability of VM sizes, see [Products available by region](https://azure.microsoft.com/regions/services/?products=virtual-machines). |
24 | 32 |
|
25 |
| -In this process, you have the option of selecting either **Visualization** or **Compute** GPUs. It's important to choose the type of GPU that's based on the software that your students will use. |
| 33 | +### Compute GPU sizes |
26 | 34 |
|
27 |
| -As described in the following table, the *compute* GPU size is intended for compute-intensive applications. For example, the [Deep Learning in Natural Language Processing class type](./class-type-deep-learning-natural-language-processing.md) uses the **Small GPU (Compute)** size. The compute GPU is suitable for this type of class, because students use deep learning frameworks and tools that are provided by the [Data Science Virtual Machine image](https://azuremarketplace.microsoft.com/en-us/marketplace/apps?search=Data%20science%20Virtual%20machine&page=1&filters=microsoft%3Blinux) to train deep learning models with large sets of data. |
| 35 | +The *compute* GPU size is intended for compute-intensive applications. For example, the [Deep Learning in Natural Language Processing class type](./class-type-deep-learning-natural-language-processing.md) uses the **Small GPU (Compute)** size. The compute GPU is suitable for this type of class, because lab users apply deep learning frameworks and tools that are provided by the [Data Science Virtual Machine image](https://azuremarketplace.microsoft.com/en-us/marketplace/apps?search=Data%20science%20Virtual%20machine&page=1&filters=microsoft%3Blinux) to train deep learning models with large sets of data. |
28 | 36 |
|
29 | 37 | | Size | vCPUs | RAM | Description |
|
30 | 38 | | ---- | ----- | --- | ----------- |
|
31 | 39 | | Small GPU (Compute) | 6 vCPUs | 112 GB RAM | [Standard_NC6s_v3](../virtual-machines/ncv3-series.md). This size supports both Windows and Linux and is best suited for compute-intensive applications such as artificial intelligence (AI) and deep learning. |
|
32 | 40 |
|
33 |
| -The *visualization* GPU sizes are intended for graphics-intensive applications. For example, the [SOLIDWORKS engineering class type](./class-type-solidworks.md) shows using the **Small GPU (Visualization)** size. The visualization GPU is suitable for this type of class, because students interact with the SOLIDWORKS 3D computer-aided design (CAD) environment for modeling and visualizing solid objects. |
| 41 | +### Visualization GPU sizes |
| 42 | + |
| 43 | +The *visualization* GPU sizes are intended for graphics-intensive applications. For example, the [SOLIDWORKS engineering class type](./class-type-solidworks.md) shows using the **Small GPU (Visualization)** size. The visualization GPU is suitable for this type of class, because lab users interact with the SOLIDWORKS 3D computer-aided design (CAD) environment for modeling and visualizing solid objects. |
34 | 44 |
|
35 | 45 | | Size | vCPUs | RAM | Description |
|
36 | 46 | | ---- | ----- | --- | ----------- |
|
37 | 47 | | Small GPU (Visualization) | 8 vCPUs | 28 GB RAM | [Standard_NV8as_v4](../virtual-machines/nvv4-series.md). This size is best suited for remote visualization, streaming, gaming, and encoding that use frameworks such as OpenGL and DirectX. Currently, this size supports Windows only. |
|
38 | 48 | | Medium GPU (Visualization) | 12 vCPUs | 112 GB RAM | [Standard_NV12s_v3](../virtual-machines/nvv3-series.md). This size supports both Windows and Linux. It's best suited for remote visualization, streaming, gaming, and encoding that use frameworks such as OpenGL and DirectX. |
|
39 | 49 |
|
40 |
| -> [!NOTE] |
41 |
| -> You may not see some of these VM sizes in the list when creating a lab. This list is populated based on the capacity assigned to your Microsoft-managed Azure subscription. For more information about capacity, see [Capacity limits in Azure Lab Services](../lab-services/capacity-limits.md). For availability of VM sizes, see [Products available by region](https://azure.microsoft.com/regions/services/?products=virtual-machines). |
42 |
| -
|
43 | 50 | ## Ensure that the appropriate GPU drivers are installed
|
44 | 51 |
|
45 | 52 | To take advantage of the GPU capabilities of your lab VMs, ensure that the appropriate GPU drivers are installed. In the lab creation wizard, when you select a GPU VM size, you can select the **Install GPU drivers** option. This option is enabled by default.
|
46 | 53 |
|
47 |
| - |
| 54 | +:::image type="content" source="./media/how-to-setup-gpu/lab-gpu-drivers.png" alt-text="Screenshot of the New lab page in the Lab Services website, highlighting the Install GPU drivers" option.::: |
48 | 55 |
|
49 |
| -Selecting **Install GPU drivers** ensures that recently released drivers are installed for the type of GPU and image that you selected. |
| 56 | +When you select **Install GPU drivers**, it ensures that recently released drivers are installed for the type of GPU and image that you selected. |
50 | 57 |
|
51 | 58 | - When you select the Small GPU *(Compute)* size, your lab VMs are powered by the [NVIDIA Tesla V100 GPU](https://www.nvidia.com/en-us/data-center/v100/) GPU. In this case, recent Compute Unified Device Architecture (CUDA) drivers are installed, which enables high-performance computing.
|
52 |
| -- When you select the Small GPU *(Visualization)* size, your lab VMs are powered by the [AMD Raedon Instinct MI25 Accelerator GPU](https://www.amd.com/en/products/professional-graphics/instinct-mi25). In this case, recent AMD GPU drivers are installed, which enables the use of graphics-intensive applications. |
| 59 | +- When you select the Small GPU *(Visualization)* size, your lab VMs are powered by the [AMD Radeon Instinct MI25 Accelerator GPU](https://www.amd.com/en/products/professional-graphics/instinct-mi25). In this case, recent AMD GPU drivers are installed, which enables the use of graphics-intensive applications. |
53 | 60 | - When you select the Medium GPU *(Visualization)* size, your lab VMs are powered by the [NVIDIA Tesla M60](https://images.nvidia.com/content/tesla/pdf/188417-Tesla-M60-DS-A4-fnl-Web.pdf) GPU and [GRID technology](https://www.nvidia.com/content/dam/en-zz/Solutions/design-visualization/solutions/resources/documents1/NVIDIA_GRID_vPC_Solution_Overview.pdf). In this case, recent GRID drivers are installed, which enables the use of graphics-intensive applications.
|
54 | 61 |
|
55 | 62 | > [!IMPORTANT]
|
56 |
| -> The **Install GPU drivers** option only installs the drivers when they aren't present on your lab's image. For example, NVIDIA GPU drivers are already installed on the Azure marketplace's [Data Science image](../machine-learning/data-science-virtual-machine/overview.md#whats-included-on-the-dsvm). If you create a Small GPU (Compute) lab using the Data Science image and choose to **Install GPU drivers**, the drivers won't be updated to a more recent version. To update the drivers, you will need to manually install them as explained in the next section. |
| 63 | +> The **Install GPU drivers** option only installs the drivers when they aren't present on your lab's image. For example, NVIDIA GPU drivers are already installed on the Azure marketplace's [Data Science Virtual Machine image](../machine-learning/data-science-virtual-machine/overview.md#whats-included-on-the-dsvm). If you create a Small GPU (Compute) lab using the Data Science image and choose to **Install GPU drivers**, the drivers won't be updated to a more recent version. To update the drivers, you will need to manually install the drivers. |
57 | 64 |
|
58 |
| -### Install the drivers manually |
| 65 | +### Install GPU drivers manually |
59 | 66 |
|
60 | 67 | You might need to install a different version of the drivers than the version that Azure Lab Services installs for you. This section shows how to manually install the appropriate drivers.
|
61 | 68 |
|
62 | 69 | #### Install the Small GPU (Compute) drivers
|
63 | 70 |
|
64 | 71 | To manually install drivers for the Small GPU *(Compute)* size, follow these steps:
|
65 | 72 |
|
66 |
| -1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
| 73 | +1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
67 | 74 |
|
68 |
| -1. After your lab is created, connect to the template VM to install the appropriate drivers. Read [NVIDIA Tesla (CUDA) drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-tesla-cuda-drivers) for more information about specific driver versions that are recommended depending on the Windows OS version being used. Otherwise, follow the below steps to install the latest NVIDIA drivers: |
| 75 | +1. After your lab is created, connect to the template VM to install the appropriate drivers. |
69 | 76 |
|
70 |
| -  |
| 77 | + - Follow the detailed installation steps in [NVIDIA Tesla (CUDA) drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-tesla-cuda-drivers) for more information about specific driver versions that are recommended depending on the Windows OS version being used. |
71 | 78 |
|
72 |
| - Otherwise, follow the below steps to install the latest NVIDIA drivers: |
| 79 | + :::image type="content" source="./media/how-to-setup-gpu/nvidia-driver-download.png" alt-text="Screenshot of the NVIDIA Driver Downloads page"::: |
73 | 80 |
|
74 |
| - a. In a browser, go to the [NVIDIA Driver Downloads page](https://www.nvidia.com/Download/index.aspx). |
75 |
| - b. Set the **Product Type** to **Tesla**. |
76 |
| - c. Set the **Product Series** to **V-Series**. |
77 |
| - d. Set the **Operating System** according to the type of base image you selected when you created your lab. |
78 |
| - e. Set the **CUDA Toolkit** to the version of CUDA driver that you need. |
79 |
| - f. Select **Search** to look for your drivers. |
80 |
| - g. Select **Download** to download the installer. |
81 |
| - h. Run the installer so that the drivers are installed on the template VM. |
| 81 | + - Alternately, follow these steps to install the latest NVIDIA drivers: |
| 82 | + 1. Go to the [NVIDIA Driver Downloads page](https://www.nvidia.com/Download/index.aspx). |
| 83 | + 1. Set the **Product Type** to **Tesla**. |
| 84 | + 1. Set the **Product Series** to **V-Series**. |
| 85 | + 1. Set the **Operating System** according to the type of base image you selected when you created your lab. |
| 86 | + 1. Set the **CUDA Toolkit** to the version of CUDA driver that you need. |
| 87 | + 1. Select **Search** to look for your drivers. |
| 88 | + 1. Select **Download** to download the installer. |
| 89 | + 1. Run the installer so that the drivers are installed on the template VM. |
82 | 90 |
|
83 | 91 | 1. Validate that the drivers are installed correctly by following instructions in the [Validate the installed drivers](how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
|
84 |
| -1. After you've installed the drivers and other software that is required for your class, select **Publish** to create your students' VMs. |
| 92 | + |
| 93 | +1. After you've installed the drivers and other software that is required for your class, select **Publish** to create the lab virtual machines. |
85 | 94 |
|
86 | 95 | > [!NOTE]
|
87 | 96 | > If you're using a Linux image, after you've downloaded the installer, install the drivers by following the instructions in [Install CUDA drivers on Linux](../virtual-machines/linux/n-series-driver-setup.md?toc=%2fazure%2fvirtual-machines%2flinux%2ftoc.json#install-cuda-drivers-on-n-series-vms).
|
88 | 97 |
|
89 | 98 | #### Install the Small GPU (Visualization) drivers
|
90 | 99 |
|
91 |
| -To manually install drivers for the Small GPU *(visualization)* size, doing the following steps: |
| 100 | +To manually install drivers for the Small GPU *(visualization)* size, follow these steps: |
| 101 | + |
| 102 | +1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
92 | 103 |
|
93 |
| -1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
94 | 104 | 1. After your lab is created, connect to the template VM to install the appropriate drivers.
|
95 |
| -1. Install the AMD drivers template VM by following instructions in the [Install AMD GPU drivers on N-series VMs running Windows](../virtual-machines/windows/n-series-amd-driver-setup.md) article. |
| 105 | + |
| 106 | +1. Install the AMD drivers template VM by following the instructions in [Install AMD GPU drivers on N-series VMs running Windows](../virtual-machines/windows/n-series-amd-driver-setup.md). |
| 107 | + |
96 | 108 | 1. Restart the template VM.
|
| 109 | + |
97 | 110 | 1. Validate that the drivers are installed correctly by following the instructions in the [Validate the installed drivers](./how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
|
98 |
| -1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your students' VMs. |
| 111 | + |
| 112 | +1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your lab virtual machines. |
99 | 113 |
|
100 | 114 | #### Install the Medium GPU (Visualization) drivers
|
101 | 115 |
|
102 |
| -1. In the lab creation wizard, when you're [creating your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
| 116 | +To manually install drivers for the Medium GPU *(visualization)* size, follow these steps: |
| 117 | + |
| 118 | +1. In the lab creation wizard, when you [create your lab](./how-to-manage-labs.md), disable the **Install GPU drivers** setting. |
| 119 | + |
103 | 120 | 1. After your lab is created, connect to the template VM to install the appropriate drivers.
|
| 121 | + |
104 | 122 | 1. Install the GRID drivers that are provided by Microsoft on the template VM by following the instructions for your operating system:
|
| 123 | + |
105 | 124 | - [Windows NVIDIA GRID drivers](../virtual-machines/windows/n-series-driver-setup.md#nvidia-grid-drivers)
|
106 | 125 | - [Linux NVIDIA GRID drivers](../virtual-machines/linux/n-series-driver-setup.md?toc=%2fazure%2fvirtual-machines%2flinux%2ftoc.json#nvidia-grid-drivers)
|
107 | 126 |
|
108 | 127 | 1. Restart the template VM.
|
| 128 | + |
109 | 129 | 1. Validate that the drivers are installed correctly by following the instructions in the [Validate the installed drivers](how-to-setup-lab-gpu.md#validate-the-installed-drivers) section.
|
110 |
| -1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your students' VMs. |
| 130 | + |
| 131 | +1. After you've installed the drivers and other software that are required for your class, select **Publish** to create your lab virtual machines. |
111 | 132 |
|
112 | 133 | ### Validate the installed drivers
|
113 | 134 |
|
@@ -142,8 +163,6 @@ To verify driver installation for Linux images, see [verify driver installation
|
142 | 163 |
|
143 | 164 | ## Next steps
|
144 | 165 |
|
145 |
| -See the following articles: |
146 |
| - |
147 |
| -- As an administrator, [create and manage labs](how-to-manage-labs.md). |
148 |
| -- As an educator, create a class using [SOLIDWORKS computer-aided design (CAD)](class-type-solidworks.md) software. |
149 |
| -- As an educator, create a class using [MATLAB (matrix laboratory)](class-type-matlab.md) software. |
| 166 | +- Learn how to [create and manage labs](how-to-manage-labs.md). |
| 167 | +- Create a lab with the [SOLIDWORKS computer-aided design (CAD)](class-type-solidworks.md) software. |
| 168 | +- Create a lab with the [MATLAB (matrix laboratory)](class-type-matlab.md) software. |
0 commit comments