@@ -3,20 +3,31 @@ Glossary
3
3
4
4
.. glossary ::
5
5
6
- Task
7
- A unit of work within the system. It represents one complete processing step in a workflow.
6
+ Environment
7
+ An environment refers to a specific software encapsulation, such as a Docker
8
+ or Singularity image, that is used to run a task.
8
9
9
- Worker
10
- Encapsulation of a task execution environment. It is responsible for executing
11
- tasks and managing their lifecycle. Workers can be local (e.g., a thread or
12
- process) or remote (e.g., high-performance cluster).
10
+ Field
11
+ A field is a parameter of a task, or a task outputs object, that can be set to
12
+ a specific value. Fields are specified to be of any types, including objects
13
+ and file-system objects.
14
+
15
+ Hook
16
+ A hook is a user-defined function that is executed at a specific point in the task
17
+ execution process. Hooks can be used to prepare/finalise the task cache directory
18
+ or send notifications
13
19
14
20
Job
15
21
A task that has been instantiated with resolved with concrete inputs.
16
- (i.e. not lazy-values or state-arrays) and assigned to a worker.
22
+ (i.e. not lazy-values or state-arrays) and assigned to a worker. Whereas a
23
+ a task describes "what" is to be done and a submitter object describes
24
+ "how" it is to be done, a job combines them both to describe a concrete unit
25
+ of processing.
17
26
18
- Workflow
19
- A series of tasks executed in a specific order.
27
+ Lazy-fields
28
+ A lazy-field is a field that is not immediately resolved to a value. Instead,
29
+ it is a placeholder that will be resolved at runtime, allowing for dynamic
30
+ parameterisation of tasks.
20
31
21
32
Node
22
33
A single task within the context of a workflow, which is assigned a name and
@@ -26,3 +37,28 @@ Glossary
26
37
The combination of all upstream splits and combines with any splitters and
27
38
combiners for a given node, it is used to track how many jobs, and their
28
39
parameterisations, need to be run for a given workflow node.
40
+
41
+ State-array
42
+ A state array is a collection of parameterised tasks or values that were generated
43
+ by a split operation either at the current or upstream node of a workflow.
44
+
45
+ Submitter
46
+ A submitter object parameterises how a task is to be executed, by specifying
47
+ an worker, environment, cache-root directory and other key execution parameters.
48
+ The submitter
49
+
50
+ Task
51
+ A task describeas a unit of work within the system. It represents a unit of processing, either
52
+ standalone or as one step in a larger workflow. Tasks can be of various types,
53
+ including Python functions, shell commands, and nested workflows. Tasks are
54
+ parameterised, meaning they can accept inputs and produce
55
+
56
+ Worker
57
+ Encapsulation of a task execution environment. It is responsible for executing
58
+ tasks and managing their lifecycle. Workers can be local (e.g., a thread or
59
+ process) or remote (e.g., high-performance cluster).
60
+
61
+ Workflow
62
+ A Directed-Acyclic-Graph (DAG) of parameterised tasks, to be executed in order.
63
+ Note that a Workflow object is created by a WorkflowTask, by the WorkflowTask's
64
+ `construct() ` method at runtime.
0 commit comments