Package modules

The engine consists of the following modules: -

decoder.py

Logic surrounding the workflow schema. It primary method is validate_schema() used to validate a workflow file against the schema. It also offers a number of utility methods to access partf of the workflow definition. SO the engine tends to call functions defined here rather than dissect the workflow file itself. This way, knowledge of the workflow file structure is concentrated in one module, and the engine does not have to know where the step names are, it just calls get_step_names().

workflow_abc.py

Here abstract base classes are defined for external services the engine depends upon. It is here we find the definition of the API and instance launcher the engine needs.

workflow_engine.py

The engine login

workflow_validator.py

The logic that is responsible for validating a workflow for the various levels of execution. A WorkflowValidator class provides validation for CREATE, TAG and RUN levels of execution.