@@ -174,7 +174,9 @@ Workflow execution with HTCondor DAGMan is done by calling::
174
174
workflow.run(plugin='CondorDAGMan')
175
175
176
176
Job execution behavior can be tweaked with the following optional plug-in
177
- arguments::
177
+ arguments. The value of most arguments can be a literal string or a filename,
178
+ where in the latter case the content of the file will be used as the argument
179
+ value::
178
180
179
181
submit_template : submit spec template for individual jobs in a DAG (see
180
182
CondorDAGManPlugin.default_submit_template for the default.
@@ -190,14 +192,24 @@ arguments::
190
192
wrapper_args : optional additional arguments to a wrapper command
191
193
dagman_args : arguments to be prepended to the job execution script in the
192
194
dagman call
195
+ block : if True the plugin call will block until Condor has finished
196
+ prcoessing the entire workflow (default: False)
193
197
194
198
Please see the `HTCondor documentation `_ for details on possible configuration
195
199
options and command line arguments.
196
200
197
201
Using the ``wrapper_cmd `` argument it is possible to combine Nipype workflow
198
202
execution with checkpoint/migration functionality offered by, for example,
199
- DMTCP _. On a Debian system, executing a workflow with support for
200
- checkpoint/migration for all nodes could look like this::
203
+ DMTCP _. This is especially useful in the case of workflows with long running
204
+ nodes, such as Freesurfer's recon-all pipeline, where Condor's job
205
+ prioritization algorithm could lead to jobs being evicted from compute
206
+ nodes in order to maximize overall troughput. With checkpoint/migration enabled
207
+ such a job would be checkpointed prior eviction and resume work from the
208
+ checkpointed state after being rescheduled -- instead of restarting from
209
+ scratch.
210
+
211
+ On a Debian system, executing a workflow with support for checkpoint/migration
212
+ for all nodes could look like this::
201
213
202
214
# define common parameters
203
215
dmtcp_hdr = """
0 commit comments