Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -128,6 +128,7 @@ jobs:
- "mssm"
- "munin"
- "nci_gadi"
- "newcastle"
- "nu_genomics"
- "nygc"
- "nyu_hpc"
Expand Down
22 changes: 22 additions & 0 deletions conf/newcastle.config
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You have no resource limits specified, are there no limits?

Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
params {
config_profile_description = 'Newcastle HPC cluster profile'
config_profile_contact = 'Chris Wyatt (@chriswyatt1), Fernando Duarte (@FernandoDuarteF)'
config_profile_url = ''
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Missing URL of cluster or instituteion

}

executor {
name = 'slurm'
}

process {
scratch = true
errorStrategy = { task.exitStatus in [137, 140] ? 'retry' : 'finish' }
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This should already be in nf-core pipelines, but with an improved range: https://github.com/nf-core/tools/blob/75e643ad2c62cdc8ecd39aa56c0c314efd4b13e4/nf_core/pipeline-template/conf/base.config#L18

If you are adding this for non-official nf-core pipelines, I would recommend at least to match the nf-core one.

queue = 'defq' // maps to `#SBATCH -p defq`
clusterOptions = '--account=DESIM' // maps to `#SBATCH -A DESIM`
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to confirm, this works for every single user of the cluster?

}

singularity {
enabled = true
pullTimeout = '2 h'
autoMounts = true
}
46 changes: 46 additions & 0 deletions docs/newcastle.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# nf-core/configs: Newcastle HPC Configuration

Configuration for the Newcastle high performance computing (HPC) cluster.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this University of Newcastle?


## Setup

To install nextflow we first need to get the prequisite java from module avail:

`module load Java/17.0.6`

Then installing Nextflow using the standard install options:
https://www.nextflow.io/docs/latest/install.html

`curl -s https://get.nextflow.io | bash`

Make Nextflow executable:

`chmod +x nextflow`

Then move Nextflow into an executable path. For example:

`mkdir -p $HOME/bin/`
`mv nextflow $HOME/bin/`

To ensure this works every time you login to the cluster, put inside your `~/.bash_profile` the java install:

`nano ~/.bash_profile`

Then paste in the line for the java install:

```
#Java module add v17:
module load Java/17.0.6
```

Exit nano with, control-X, then y to save, then enter to confirm

## Run

To use this profile, simply pass Nextflow the -profile newcastle flag eg.

```bash
nextflow run nf-core/_pipeline_ -profile newcastle --outdir results
```

In case of issues, please feel free to reach out to one of the maintainers (Chris Wyatt or Fernando Duarte) at ecoflow.ucl@gmail.com . We are based at UCL, but helped set up this config, and are happy to help.
3 changes: 3 additions & 0 deletions nfcore_custom.config
Original file line number Diff line number Diff line change
Expand Up @@ -292,6 +292,9 @@ profiles {
nci_gadi {
includeConfig "${params.custom_config_base}/conf/nci_gadi.config"
}
newcastle {
includeConfig "${params.custom_config_base}/conf/newcastle.config"
}
nu_genomics {
includeConfig "${params.custom_config_base}/conf/nu_genomics.config"
}
Expand Down
Loading