Skip to content

Merge dev features to main#308

Draft
CormacKinsella wants to merge 82 commits intomainfrom
merge_dev
Draft

Merge dev features to main#308
CormacKinsella wants to merge 82 commits intomainfrom
merge_dev

Conversation

@CormacKinsella
Copy link
Member

@CormacKinsella CormacKinsella commented Nov 11, 2025

This PR:

  • Branched off main and cherry picked polishing subworkflow commits from dev
  • Resolved file conflicts
  • Moved polish subworkflow to 06_polish + deepvariant to subtool directory
  • Updated nf-core manifest & patches
  • Removed redundant EVALUATE subworkflow call
  • Other small fixes for upstream compatibility, e.g., syntax/updating function calls
  • Resolved incompatibility with test dataset & DeepVariant, via replace pacbio test data set fa with fq #339

Additionally, via #343:

  • Clean up and standardise POLISH section of modules.config

  • Fix version reporting for some modules

  • Change compression tool in CREATE_FINAL_ASM for downstream compatibility with FAIDX

  • Fix DVPOLISH_PBMM2_ALIGN orphan process - pass mmi index into alignment

  • Removed redundant addition of single_end metadata field (handled in PREPARE_INPUT)

  • Refactored SAMTOOLS_INDEX logic -> this indexed bams that were then merged and re-indexed

  • Patched merqury, updated bioconda + container to fix bug causing empty scaffold qv file (meryl dependency to 1.4.1)

  • Edited meryl/unionsum -> merqury expects databases with .meryl suffix

  • Refactor createFinalAsm.nf, include a log of changes from unpolished to polished

  • Publish outputs

  • Emit logs/versions from subworkflow

  • assets/notebooks/_06_assembly_polishing.qmd currently empty

  • Test polish subworkflow, resolve bugs

  • Add polish swf info to report (i.e. logic choices if contig degraded or unchanged, vs improved)

  • Added DVPOLISH phased mode

  • Switched to merged hifi input and simplified logic to reflect this

  • Add tests & snapshot

@CormacKinsella
Copy link
Member Author

CormacKinsella commented Nov 11, 2025

assets/notebooks/_06_assembly_polishing.qmd currently empty

@CormacKinsella CormacKinsella force-pushed the merge_dev branch 2 times, most recently from 535c758 to 3027773 Compare December 8, 2025 08:43
* fix version reporting

* rm unused args2

* clean modules config

* pbmm2 align using prebuilt index

* fix version

* add samtools, switch to bgzip for downstream FAIDX compatibility

* exit if qv files empty

* updates to polish wf, documentation etc.

* unionsum output suffix changed for compatibility with merqury

* unionsum output updates

* update meryl dependency of merqury

* refactor create final asm

* emit logs/versions, clean up

* dvpolish summary

* address feedback

* WIP

* fix redundant naming

* enable phased mode dvpolish

* consistent haplotype naming

* remove dvpolish logic for multiple readsets/sample
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants