Skip to content

Releases: InformaticsMatters/squonk2-data-manager-workflow-engine

Initial 2.0 release

03 Dec 12:57
9946f25

Choose a tag to compare

Initial 2.0 feature set (#40)

* feat: kind-version now 2025.2

BREAKING CHANGE

* feat: Initial schema for replicate step declaration

* feat: Add get_generated_outputs_for_step_output() to API adapter

* feat: Rename new API method

* feat: Add replica to step creation (and step-by-name query)

* feat: Removed 'as' from workflow mapping output declaration

* feat: Add get_running_workflow_step_output_values_for_output() to API

* fix: Removed rogue 'print' statement

* test: Add mock of step outputs

* fix: it's a mess

* docs: Add instance-directory comment

* feat: Creating instances now adds instance-directory property to step record

* fix: get_instance() response type

* test: Add tests for instance_directory

* build: Add experimental json copy of the schema

* style: Removed unnecessary json schema file

* fix: Better rfc1035-label-name pattern

* fix: Better rfc1035-label-name regex

* test: Fix decoder tests

* test: Fix test module name (for consistency)

* Remove unnecessary logic

* fix: stashing

* fix: stashing

* refactor: Major refactor (new variable-mapping schema)

* refactor: from-workflow-variable becomes from-workflow

* refactor: from-workflow-variable becomes from-workflow

* refactor: Replicate now uses variable not input

* fix: No longer need realise-outputs

* build: Add devcontainer

* build: No need for DinD

* docs: Docs on devcontainer

* docs: Doc tweak

* feat: Some work on the refactored engine

* fix: More fixes for engine

* fix: More work on the decoder

* fix: Variable mapping now exposed as a Translation dataclass

* fix: Major refactoring of logic (for new launch/workflow API)

* feat: First successful replicating workflow test

* feat: Use of decoder 2.4.0 (traits)

* refactor: Switch away from workflow replicate property

* refactor: Refactored using decoder 2.5.0

* docs: Doc tweak

* refactor: variable-map is now  'plumbing' and Translation is a 'Connector'

* refactor: Better function and variable naming (plumbing)

* feat: new _prepare_step_variables function

* feat: Refactoring

* refactor: More combiner logic

* feat: refactor definition of an output

* fix: Add get_status_of_all_step_instances_by_name implementation (and fix step replicas)

* docs: Doc tweak

* fix: Typo in YAML

* feat: Minor work on combiner logic

* fix: First very basic combiner run

* docs: Doc tweak

* fix: replica always starts at 0

* docs: Doc tweak

* feat: Add from-link-prefix variables

* feat: Switch to pre-defined variables (rather then link)

* fix: Fix input output hanes in decoder

* fix: Add from-project support

* refactor: lin-prefix becomes link-glob

* fix: Return kwargs to launch()

* feat: Add dependent_instances to LaunchParameters

* feat: Populate dependent_instances

* refactor: link-glob is now instance-link-glob

* refactor: Remove to/from project schema

* feat: Add outputs to step prepration response

* test: Attempt to fix tests

* test: Fix instance creation

* fix: Fix test execution

* docs: Significant level of module documentation

* docs: More docs

* docs: Doc tweak

* docs: More doc and typo corrections

* docs: Code typos corrected

* dev: Logs end of step and end of running workflow

* dev: Engine now collects inputs and sets LP inputs & outputs

* style: Log inputs

* dev: Fix handling of launch() result

* fix: Better handling of get_running_workflow_step_by_name() response

* feat: Engine now attempts to prefix inputs (from prior steps)

* fix: Fix prior-step prefix

* fix: Launch parameter sets are now lists

* dev: fix build

* docs: Doc tweak

* dev: Fix instance prefix

* fix: Engine now handles lack of job better

* fix: Validator now ensures jobs exist (run-level test)

* fix: Better testing of validation (job must be present)

* feat: Better validation error message

* test: Fix tests

* fix: Better handling of lack of outputs

* docs: Doc tweak

* fix: Fix iteration input path

* test: Disable unit test

* fix: Support for dirsGlob

* fix: Better step preparation initial log (combiners)

* fix: Combiners no longer get built-in variables automatically (#39)

---------

Co-authored-by: Alan Christie <[email protected]>
Co-authored-by: Kalev Takkis <[email protected]>

Initial 2.0 feature set

02 Dec 09:50
5743f97

Choose a tag to compare

Pre-release
2.0.0-rc.1

fix: Combiners no longer get built-in variables automatically (#39)

Combiners no longer get built-in variables

01 Dec 14:19
5743f97

Choose a tag to compare

2.0.0-beta.8

fix: Combiners no longer get built-in variables automatically (#39)

Combiners no longer get built-in variables

01 Dec 14:10
5743f97

Choose a tag to compare

2.0.0-beat.8

fix: Combiners no longer get built-in variables automatically (#39)

Better prep logging

15 Oct 15:21

Choose a tag to compare

Better prep logging Pre-release
Pre-release
2.0.0-beta.7

fix: Better step preparation initial log (combiners)

Support for dirsGlob

15 Oct 13:09

Choose a tag to compare

Support for dirsGlob Pre-release
Pre-release
2.0.0-beta.6

fix: Support for dirsGlob

Fix iteration variable

14 Oct 16:52

Choose a tag to compare

Pre-release
2.0.0-beta.5

test: Disable unit test

Better handling of lack of outputs (prior step)

14 Oct 10:03

Choose a tag to compare

2.0.0-beta.4

fix: Better handling of lack of outputs

Better validation error message

02 Oct 19:00

Choose a tag to compare

Pre-release
2.0.0-beta.3

test: Fix tests

Better validation (job must exist)

30 Sep 16:40

Choose a tag to compare

Pre-release
2.0.0-beta.2

fix: Better testing of validation (job must be present)