You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/docs/how-tos/use-gpus.mdx
+13-57Lines changed: 13 additions & 57 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -30,68 +30,24 @@ Overview of using GPUs on Nebari including server setup, environment setup, and
30
30
31
31
## 2. Creating environments
32
32
33
-
By default, `conda-store` will build CPU-compatible packages. To build GPU-compatible packages, we do the following.
34
33
### Build a GPU-compatible environment
35
-
By default, `conda-store` will build CPU-compatible packages. To build GPU-compatible packages, we have two options:
36
-
1.**Create the environment specification using `CONDA_OVERRIDE_CUDA` (recommended approach)**:
37
-
38
-
Conda-store provides an alternate mechanism to enable GPU environments via the setting of an environment variable as explained in the [conda-store docs](https://conda.store/conda-store-ui/tutorials/create-envs#set-environment-variables).
39
-
While creating a new config, click on the `**GUI <-> YAML**` Toggle to edit yaml config.
40
-
```
41
-
channels:
42
-
- pytorch
43
-
- conda-forge
44
-
dependencies:
45
-
- pytorch
46
-
- ipykernel
47
-
variables:
48
-
CONDA_OVERRIDE_CUDA: "12.1"
49
-
```
50
-
Alternatively, you can configure the same config using the UI.
51
-
52
-
Add the `CONDA_OVERRIDE_CUDA` override to the variables section to tell conda-store to build a GPU-compatible environment.
34
+
conda-store provides an alternate mechanism to enable GPU environments via the setting of an environment variable as explained in the [conda-store docs](https://conda.store/conda-store-ui/tutorials/create-envs#set-environment-variables).
35
+
Create the environment specification using `CONDA_OVERRIDE_CUDA` by creating a new environment and clicking on the `**GUI <-> YAML**` toggle to edit the yaml config.
36
+
```yaml
37
+
channels:
38
+
- conda-forge
39
+
dependencies:
40
+
- pytorch
41
+
- ipykernel
42
+
variables:
43
+
CONDA_OVERRIDE_CUDA: "12.4"
44
+
```
45
+
Alternatively, you can configure the same variable using the UI.
53
46
54
47
:::note
55
-
At the time of writing this document, the latest CUDA version was showing as `12.1`. Please follow the steps below to determine the latest override value for the `CONDA_OVERRIDE_CUDA` environment variable.
56
-
57
-
Please ensure that your choice from PyTorch documentation is not greater than the highest supported version in the `nvidia-smi` output (captured above).
48
+
At the time of writing this document, the latest CUDA version was showing as `12.4`. Please follow the steps [above](#understanding-gpu-setup-on-the-server) to determine the highest supported version to use as an override value for the `CONDA_OVERRIDE_CUDA` environment variable.
58
49
:::
59
50
60
-
2.**Create the environment specification based on recommendations from the PyTorch documentation**:
61
-
You can check [PyTorch documentation](https://pytorch.org/get-started/locally/) to get a quick list of the necessary CUDA-specific packages.
62
-
Select the following options to get the latest CUDA version:
63
-
- PyTorch Build = Stable
64
-
- Your OS = Linux
65
-
- Package = Conda
66
-
- Language = Python
67
-
- Compute Platform = 12.1 (Select the version that is less than or equal to the `nvidia-smi` output (see above) on your server)
The order of the channels is respected by conda, so keep pytorch at the top, then nvidia, then conda-forge.
91
-
92
-
You can use `**GUI <-> YAML**` Toggle to edit the config.
93
-
94
-
95
51
## 3. Validating the setup
96
52
You can check that your GPU server is compatible with your conda environment by opening a Jupyter Notebook, loading the environment, and running the following code:
0 commit comments