-
Notifications
You must be signed in to change notification settings - Fork 0
Filesystem directories (Projects and Instances)
Jobs and Workflows are executed by users in a DM Project for which they have editorial authority. When a user creates a project the DM creates a project volume where files (and Datasets) can be deposited.
When a user executes a Workflow they execute the workflow in a Project. Steps in the Workflow are run as Data Manager Instances (a Kubernetes Pod) and are given their own directory inside the Project which is mounted into the Pod (typically at /work
) where they run. Importantly Instances do not have general access to the Project filesystem, they are physically prevented from accessing files that are not in their own instance directory by the underlying filesystem.
If a Step (Job) needs to access Project files (or files generated by other steps) it must declare this need. We'll discuss this in detail in the next section.