-
Notifications
You must be signed in to change notification settings - Fork 815
Optimize qualimap performance with multi-threaded name sorting #1621
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: dev
Are you sure you want to change the base?
Conversation
Pre-sort BAM files by read name using samtools with multi-threading before running qualimap rnaseq. This reduces qualimap execution time by >50% (from ~85 min to <40 min) by offloading the single-threaded sorting to the multi-threaded samtools sort with the -n flag, then passing the sorted BAM to qualimap with the --sorted flag. Resolves #1356 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>
Add changelog entry for PR #1621 which optimizes qualimap performance through multi-threaded name sorting. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>
|
Prevent the name-sorted BAM files created for qualimap from being published as they are only intermediate files used for performance optimization. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>
Add SAMTOOLS_SORT_QUALIMAP version entry to all test snapshots that run qualimap, reflecting the new samtools sort step added for performance optimization. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>
Increment version counts by 5 in test blocks that run qualimap to account for the additional SAMTOOLS_SORT_QUALIMAP process. Only test blocks containing QUALIMAP_RNASEQ are updated. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <[email protected]>
MatthiasZepper
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM.
There is already a namesorting step in the UMI deduplication subworkflow, so one could possibly use the namesorted output after UMI deduplication directly for Qualimap when available and save some compute on the sorting, but this will introduce significant additional complexity.
In the interest of maintainability and modularity, I suggest to keep it this way.
Summary
This PR optimizes the qualimap rnaseq step by pre-sorting BAM files using multi-threaded samtools before running qualimap with the
--sortedflag.Changes
SAMTOOLS_SORT_QUALIMAPprocess beforeQUALIMAP_RNASEQin the workflow-nflag for name-based sorting with multi-threading--sortedflag with pre-sorted BAM filesPerformance Impact
Based on the original issue report, this optimization reduces total execution time from ~85 minutes to under 40 minutes:
This represents a >50% reduction in execution time for the qualimap step.
Testing
Resolves #1356
🤖 Generated with Claude Code