Serialise accelerator tasks only on local executor? #3806
Unanswered
SamStudio8
asked this question in
Q&A
Replies: 1 comment 3 replies
-
Only for a specific process or for the overall pipeline (ie. run only one task at time)? |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Is there an idiom for setting maxForks to 1 for a particular process but only when the executor is local? As Nextflow does not manage GPU devices (to prevent scheduling processes to the same GPU device), I would like to automatically configure a workflow to serialise GPU tasks for local executors -- without user intervention.
I note that it is one of the directives that cannot be set dynamically (so no closures); is there a trick I am missing? Otherwise it would be useful if one could cap the number of
accelerators
in theexecutor.$local
config like you can withcpus
andmemory
, which would have the same effect without having to use maxForks.Beta Was this translation helpful? Give feedback.
All reactions