Skip to content
This repository was archived by the owner on Aug 9, 2023. It is now read-only.

Minor Release - v2.5.0

Choose a tag to compare

@wleepang wleepang released this 21 Dec 05:31
· 390 commits to release since this release
708e176

Bug Fixes

Improvements

  • Adding SSM agent and permissions to Batch hosts to allow SSM capabilities like Session Manager to facilitate troubleshooting via SSH without needing an EC2 keypair.
  • refactor containers and job defs
  • use host bind mounted awscli
  • use job def environment variables for execution options
  • use common entrypoint script for all containers
  • update sfn example to use dynamic parallelism
  • remove unneeded parameters from job definitions
  • update example workflow input
  • update build dependencies
  • explicitly add pip
  • unpin cfn-lint. we need this to stay up to date.
  • use common build script for tooling containers
  • add container build template
  • refactor step functions stack into separate templates
  • create a generic workflow template that uses nested templates to build individual containers and the state machine for the workflow
  • simplify the workflow definition templates - the container builds and IAM role creation happens in parent templates
  • add UpdateReplacePolicy for S3 Buckets

Documentation Updates

  • update nextflow documentation
    • fix a couple inconsistencies
    • improve flow and clarity
    • typo fixes
  • update step functions docs
    • update images
    • add more details on job definition and sfn task
    • add more details on the example workflow
    • fix job output prefix in example input
    • update workflow completion time
    • add more detailed explanations of important job def parts and how they translate into sfn task code.