This repository was archived by the owner on Aug 9, 2023. It is now read-only.
Minor Release - v2.5.0
Bug Fixes
- explicitly stop ecs before starting ebs autoscale on /var/lib/docker
- move nextflow additions to before start ecs
- add steps missing that are documented in https://docs.docker.com/storage/storagedriver/btrfs-driver/
Improvements
- Adding SSM agent and permissions to Batch hosts to allow SSM capabilities like Session Manager to facilitate troubleshooting via SSH without needing an EC2 keypair.
- refactor containers and job defs
- use host bind mounted awscli
- use job def environment variables for execution options
- use common entrypoint script for all containers
- update sfn example to use dynamic parallelism
- remove unneeded parameters from job definitions
- update example workflow input
- update build dependencies
- explicitly add pip
- unpin cfn-lint. we need this to stay up to date.
- use common build script for tooling containers
- add container build template
- refactor step functions stack into separate templates
- create a generic workflow template that uses nested templates to build individual containers and the state machine for the workflow
- simplify the workflow definition templates - the container builds and IAM role creation happens in parent templates
- add UpdateReplacePolicy for S3 Buckets
Documentation Updates
- update nextflow documentation
- fix a couple inconsistencies
- improve flow and clarity
- typo fixes
- update step functions docs
- update images
- add more details on job definition and sfn task
- add more details on the example workflow
- fix job output prefix in example input
- update workflow completion time
- add more detailed explanations of important job def parts and how they translate into sfn task code.