Skip to content

Commit bd1809e

Browse files
authored
Merge pull request #291 from bbglab/dev-qmap-newCPD
Revise Qmap submission instructions in the new Data Center
2 parents f0fb8f9 + 99f3b8f commit bd1809e

File tree

1 file changed

+74
-21
lines changed
  • docs/Cluster_basics/Submitting_jobs

1 file changed

+74
-21
lines changed

docs/Cluster_basics/Submitting_jobs/Qmap.md

Lines changed: 74 additions & 21 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,4 @@
1+
12
# Qmap Submit
23

34
## Description
@@ -10,43 +11,95 @@ How to submit jobs to the Cluster using **Qmap**.
1011

1112
### 1. Prepare .qmap file (example)
1213

13-
```bash
14-
[params]
15-
memory=50G
14+
=== "IRB cluster"
15+
16+
```bash
17+
[params]
18+
memory=50G
19+
20+
[pre]
21+
ml load anaconda3 #OR . "/home/$USER/miniconda3/etc/profile.d/conda.sh"
22+
conda activate sciclone-env
23+
24+
[jobs]
25+
Rscript run.R ../data/vafs.dat bmm 3 ./results.beta.3
26+
Rscript run.R ../data/vafs.dat gaussian.bmm 3 ./results.gaussian.3
27+
Rscript run.R ../data/vafs.dat binomial.bmm 3 ./results.binomial.3
28+
```
29+
30+
=== "BBG cluster"
31+
32+
```bash
33+
[params]
34+
memory=50G
35+
36+
[pre]
37+
. "/home/$USER/miniconda3/etc/profile.d/conda.sh"
38+
conda activate sciclone-env
39+
40+
[jobs]
41+
Rscript run.R ../data/vafs.dat bmm 3 ./results.beta.3
42+
Rscript run.R ../data/vafs.dat gaussian.bmm 3 ./results.gaussian.3
43+
Rscript run.R ../data/vafs.dat binomial.bmm 3 ./results.binomial.3
44+
```
45+
46+
The only difference is how you load conda. On the IRB cluster, you can use either of the following options:
1647

17-
[pre]
18-
. "/home/$USER/miniconda3/etc/profile.d/conda.sh"
19-
conda activate sciclone-env
48+
1) Use the pre-installed conda module (`ml load anaconda3`)
2049

21-
[jobs]
22-
Rscript run.R ../data/vafs.dat bmm 3 ./results.beta.3
23-
Rscript run.R ../data/vafs.dat gaussian.bmm 3 ./results.gaussian.3
24-
Rscript run.R ../data/vafs.dat binomial.bmm 3 ./results.binomial.3
50+
2) If you use mamba or prefer to use your own conda installation,
51+
load it the same way you do on the BBG cluster:
2552

26-
```
53+
`. "/home/$USER/miniforge3/etc/profile.d/conda.sh"`
54+
55+
For micromamba:
56+
57+
`eval "$(micromamba shell hook --shell=bash)"`
2758

2859
### 2. Run "qmap submit" from the login node
2960

30-
```bash
31-
qmap submit filename.qmap
61+
=== "IRB cluster"
62+
63+
```bash
64+
interactive
65+
spack load py-qmap
66+
qmap submit filename.qmap
67+
```
3268

33-
```
69+
=== "BBG cluster"
3470

35-
## Aditional info
71+
```bash
72+
qmap submit filename.qmap
73+
```
74+
75+
## Additional info
3676

3777
### Extra parameters
3878

3979
If you need to provide any [extra parameter](https://qmap.readthedocs.io/en/latest/concepts.html#parameters) directly to
4080
SLURM, you can do it defining a new profile.config file. E.g.
4181

42-
```toml
43-
executor = slurm
82+
=== "IRB cluster"
83+
84+
```bash
85+
executor = slurm
86+
87+
[params]
88+
extra = -G 1
89+
```
90+
91+
=== "BBG cluster"
92+
93+
```bash
94+
executor = slurm
95+
96+
[params]
97+
extra = -p bigmem
98+
```
4499

45-
[params]
46-
extra = -p bigmem
47-
```
100+
By default, the queue used in the BBG cluster is `bigrun`.
48101

49-
By default, the queue used is `bigrun`.
102+
For Qmap runs using GPUs, use `-G 1`.
50103

51104
## Reference
52105

0 commit comments

Comments
 (0)