Skip to content

Comments

feat: Add cluster test pipeline for SLURM and LSF#2

Merged
jayhesselberth merged 1 commit intodevelopfrom
feature/cluster-test-pipeline
Dec 19, 2025
Merged

feat: Add cluster test pipeline for SLURM and LSF#2
jayhesselberth merged 1 commit intodevelopfrom
feature/cluster-test-pipeline

Conversation

@jayhesselberth
Copy link
Member

Summary

  • Add a test pipeline under tests/pipelines/cluster/ for testing charmer on HPC clusters
  • Create ~76 jobs with fan-out/fan-in DAG patterns to demonstrate pending job states
  • Include 4 samples designed to fail at different stages with realistic error messages
  • Add SLURM and LSF cluster profiles based on nmd-exons configuration

Test plan

  • Run locally with snakemake --cores 4 to verify DAG structure
  • Test SLURM execution with snakemake --profile cluster/slurm
  • Test LSF execution with snakemake --profile cluster/lsf
  • Verify charmer correctly displays pending, running, and failed jobs

🤖 Generated with Claude Code

Add a test pipeline under tests/pipelines/cluster/ designed to test
charmer's monitoring capabilities on HPC clusters.

Features:
- 12 samples creating ~76 total jobs with fan-out/fan-in DAG patterns
- 4 samples designed to fail at different stages with different exit codes:
  - fail-oom: alignment failure (exit 137)
  - fail-timeout: variant calling timeout (exit 124)
  - fail-error: processing error (exit 1)
  - fail-segfault: merge segfault (exit 139)
- SLURM profile for Alpine cluster (amilan partition, amc-general account)
- LSF profile with rna queue configuration
- Configurable job delays for testing pending job display

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
@jayhesselberth jayhesselberth merged commit 2e84d7e into develop Dec 19, 2025
6 checks passed
@jayhesselberth jayhesselberth deleted the feature/cluster-test-pipeline branch December 19, 2025 13:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant