Skip to content

Commit a62119a

Browse files
Merge pull request #12 from pphector/master
Added documentation of GenPipes proof of concept pipeline
2 parents 06f545b + 91c25a0 commit a62119a

File tree

3 files changed

+67
-0
lines changed

3 files changed

+67
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -26,6 +26,7 @@ Each workflow manager folder in this repository has a README detailing how to ru
2626
- [Snakemake](snakemake)
2727
- [SciPipe](scipipe)
2828
- [WDL](wdl)
29+
- [GenPipes](genpipes)
2930

3031
## Online Documentation for Workflow managers
3132
Workflow managers have many more features which are not used in these implementations, and there are many additional workflow managers. You can read more about each workflow manager in their official documentation:

genpipes/README.md

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,64 @@
1+
## About GenPipes
2+
3+
[GenPipes](https://www.computationalgenomics.ca/genpipes/) is a flexible Python-based framework that facilitates the
4+
development and deployment of multi-step workflows optimized for High-Performance Computing clusters and the cloud.
5+
GenPipes comes with 13 validated and scalable pipelines for various genomics applications.
6+
7+
## Training material and documentation
8+
9+
- [Link to tutorial](https://genpipes.readthedocs.io/en/master/tutorials/list_tutorials.html)
10+
- [Link to online documentation](https://genpipes.readthedocs.io/en/master/index.html)
11+
- [Link to developer guide](https://genpipes.readthedocs.io/en/latest/development/dev_guide.html)
12+
13+
## Community-developed workflows in GenPipes
14+
15+
- [Amplicon Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_ampliconseq.html)
16+
- [ChIP Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_chipseq.html)
17+
- [CoV Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_covseq.html)
18+
- [DNA Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_dnaseq.html)
19+
- [DNA Sequencing High Coverage Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_dnaseq_highcov.html)
20+
- [HiC Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_hicseq.html)
21+
- [Illumina Run Processing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_illumina.html)
22+
- [Methylation Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_wgs_methylseq.html)
23+
- [Nanopore Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_nanopore.html)
24+
- [RNA Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_rnaseq.html)
25+
- [De-Novo RNA Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_rnaseq_denovo.html)
26+
- [RNA Sequencing Light Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_rnaseq_light.html)
27+
- [Tumor Pair Sequencing Pipeline](https://genpipes.readthedocs.io/en/latest/user_guide/pipelines/gp_tumourpair.html)
28+
29+
## Running the proof of concept GenPipes pipeline
30+
31+
This proof of concept pipeline is implemented in the following [branch](https://bitbucket.org/mugqic/genpipes/src/goekelab_manuscript).
32+
To run this proof of concept, you need to clone the repository and change to the appropriate branch. The location of the cloned directory
33+
will be referred to as `$GENPIPES` in the following instructions.
34+
35+
1. From the cloned location, launch the pipeline using the attached [readset.txt](./readset.txt) file:
36+
37+
```
38+
python $GENPIPES/pipelines/goeke_rnaseq.py -c $GENPIPES/pipelines/goeke_rnaseq.slurm.ini --steps 1-3 --output pipeline_output --readsets readset.txt --job-scheduler slurm > run_commands.sh
39+
40+
```
41+
42+
2. To submit jobs to the scheduler just run the following command:
43+
```
44+
bash run_commands.sh
45+
```
46+
47+
*Notes:*
48+
49+
- Please note that this proof of concept pipeline requires de-compressed fastqs to work properly
50+
- When running from Compute Canada or other supported GenPipes clusters, the pipeline will load software using linux modules, if running from
51+
another location, use the [containerized version of GenPipes](https://genpipes.readthedocs.io/en/master/tutorials/genpipes_in_the_container.html).
52+
- GenPipes currently runs using python v2.7, a python v3 release is coming soon.
53+
54+
## Notes and Contribution
55+
56+
This pipeline is a minimal example of a Salmon-based pipeline using GenPipes. We welcome contributions to the documentation
57+
and workflow, please create an issue or submit a pull request!
58+
59+
## How to cite GenPipes
60+
61+
Bourgey M, Dali R, Eveleigh R, Chen KC, Letourneau L, Fillon J, Michaud M, Caron M, Sandoval J, Lefebvre F, Leveque G, Mercier E,
62+
Bujold D, Marquis P, Van PT, Anderson de Lima Morais D, Tremblay J, Shao X, Henrion E, Gonzalez E, Quirion PO, Caron B, Bourque G.
63+
**GenPipes: an open-source framework for distributed and scalable genomic analyses.** *Gigascience.* 2019 Jun 1;8(6):giz037.
64+
doi: 10.1093/gigascience/giz037. PMID: 31185495; PMCID: PMC6559338.

genpipes/readset.txt

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
1+
Sample Readset Library RunType Run Lane Adapter1 Adapter2 Primer1 Primer2 QualityOffset BED FASTQ1 FASTQ2 BAM
2+
test test_reads test_reads PAIRED_END 0000 1 33 ../test_data/reads_1.fastq ../test_data/reads_2.fastq

0 commit comments

Comments
 (0)