Skip to content

Commit 17d177e

Browse files
authored
Merge pull request #602 from nebari-dev/update-gpu-environment-setup
Update and simplify GPU environment setup instructions
2 parents 5783408 + a6cd03e commit 17d177e

File tree

2 files changed

+13
-57
lines changed

2 files changed

+13
-57
lines changed

docs/docs/how-tos/use-gpus.mdx

Lines changed: 13 additions & 57 deletions
Original file line numberDiff line numberDiff line change
@@ -30,68 +30,24 @@ Overview of using GPUs on Nebari including server setup, environment setup, and
3030

3131
## 2. Creating environments
3232

33-
By default, `conda-store` will build CPU-compatible packages. To build GPU-compatible packages, we do the following.
3433
### Build a GPU-compatible environment
35-
By default, `conda-store` will build CPU-compatible packages. To build GPU-compatible packages, we have two options:
36-
1. **Create the environment specification using `CONDA_OVERRIDE_CUDA` (recommended approach)**:
37-
38-
Conda-store provides an alternate mechanism to enable GPU environments via the setting of an environment variable as explained in the [conda-store docs](https://conda.store/conda-store-ui/tutorials/create-envs#set-environment-variables).
39-
While creating a new config, click on the `**GUI <-> YAML**` Toggle to edit yaml config.
40-
```
41-
channels:
42-
- pytorch
43-
- conda-forge
44-
dependencies:
45-
- pytorch
46-
- ipykernel
47-
variables:
48-
CONDA_OVERRIDE_CUDA: "12.1"
49-
```
50-
Alternatively, you can configure the same config using the UI.
51-
52-
Add the `CONDA_OVERRIDE_CUDA` override to the variables section to tell conda-store to build a GPU-compatible environment.
34+
conda-store provides an alternate mechanism to enable GPU environments via the setting of an environment variable as explained in the [conda-store docs](https://conda.store/conda-store-ui/tutorials/create-envs#set-environment-variables).
35+
Create the environment specification using `CONDA_OVERRIDE_CUDA` by creating a new environment and clicking on the `**GUI <-> YAML**` toggle to edit the yaml config.
36+
```yaml
37+
channels:
38+
- conda-forge
39+
dependencies:
40+
- pytorch
41+
- ipykernel
42+
variables:
43+
CONDA_OVERRIDE_CUDA: "12.4"
44+
```
45+
Alternatively, you can configure the same variable using the UI.
5346
5447
:::note
55-
At the time of writing this document, the latest CUDA version was showing as `12.1`. Please follow the steps below to determine the latest override value for the `CONDA_OVERRIDE_CUDA` environment variable.
56-
57-
Please ensure that your choice from PyTorch documentation is not greater than the highest supported version in the `nvidia-smi` output (captured above).
48+
At the time of writing this document, the latest CUDA version was showing as `12.4`. Please follow the steps [above](#understanding-gpu-setup-on-the-server) to determine the highest supported version to use as an override value for the `CONDA_OVERRIDE_CUDA` environment variable.
5849
:::
5950

60-
2. **Create the environment specification based on recommendations from the PyTorch documentation**:
61-
You can check [PyTorch documentation](https://pytorch.org/get-started/locally/) to get a quick list of the necessary CUDA-specific packages.
62-
Select the following options to get the latest CUDA version:
63-
- PyTorch Build = Stable
64-
- Your OS = Linux
65-
- Package = Conda
66-
- Language = Python
67-
- Compute Platform = 12.1 (Select the version that is less than or equal to the `nvidia-smi` output (see above) on your server)
68-
69-
![pytorch-linux-conda-version](/img/how-tos/pytorch-linux-conda-version.png)
70-
71-
The command `conda install` from above is:
72-
```
73-
conda install pytorch torchvision torchaudio pytorch-cuda=12.1 -c pytorch -c nvidia
74-
```
75-
The corresponding yaml config would be:
76-
```
77-
channels:
78-
- pytorch
79-
- nvidia
80-
- conda-forge
81-
dependencies:
82-
- pytorch
83-
- pytorch-cuda==12.1
84-
- torchvision
85-
- torchaudio
86-
- ipykernel
87-
variables: {}
88-
```
89-
:::note
90-
The order of the channels is respected by conda, so keep pytorch at the top, then nvidia, then conda-forge.
91-
92-
You can use `**GUI <-> YAML**` Toggle to edit the config.
93-
94-
9551
## 3. Validating the setup
9652
You can check that your GPU server is compatible with your conda environment by opening a Jupyter Notebook, loading the environment, and running the following code:
9753
```
-117 KB
Binary file not shown.

0 commit comments

Comments
 (0)