Skip to content

Commit ef5e98c

Browse files
authored
Merge pull request #267 from NYU-RTS/mdweisner-ood-jupyter-jobs-1
Update 07_jupyter_with_conda_singularity.mdx
2 parents 0644175 + 51acef8 commit ef5e98c

File tree

1 file changed

+12
-2
lines changed

1 file changed

+12
-2
lines changed

docs/hpc/09_ood/07_jupyter_with_conda_singularity.mdx

Lines changed: 12 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,6 +55,16 @@ The above code automatically makes your environment look for the default shared
5555
:::
5656

5757
### Prepare Overlay File
58+
First, start a job to work on the compute nodes.
59+
```bash
60+
[NetID@log-1 my_env]$ sbatch --cpus-per-task=2 --mem=10GB --time=04:00:00 --wrap "sleep infinity"
61+
62+
# wait to be assigned a node then SSH to the node
63+
```
64+
Once you SSH to the node, you can begin setting up the environment.
65+
66+
:::note Files will not properly compile on the login nodes as they have different Red Hat OS images than the compute nodes. All compilation and package installation must be done on the compute nodes.
67+
5868
```bash
5969
[NetID@log-1 ~]$ mkdir /scratch/$USER/my_env
6070
[NetID@log-1 ~]$ cd /scratch/$USER/my_env
@@ -143,9 +153,9 @@ To install larger packages, like Tensorflow, you must first start an interactive
143153
```bash
144154
Singularity> exit
145155

146-
[NetID@log-1 my_env]$ srun --cpus-per-task=2 --mem=10GB --time=04:00:00 --pty /bin/bash
156+
[NetID@log-1 my_env]$ sbatch --cpus-per-task=2 --mem=10GB --time=04:00:00 --wrap "sleep infinity"
147157

148-
# wait to be assigned a node
158+
# wait to be assigned a node then SSH to the node
149159

150160
[NetID@cm001 my_env]$ singularity exec --fakeroot --overlay /scratch/$USER/my_env/overlay-15GB-500K.ext3:rw /share/apps/images/cuda12.3.2-cudnn9.0.0-ubuntu-22.04.4.sif /bin/bash
151161

0 commit comments

Comments
 (0)