Skip to content

Commit d5cb91a

Browse files
Slurm: Add section 'Known issue "Error Future of class BatchtoolsSlurmFuture expired"'
1 parent 51131d9 commit d5cb91a

10 files changed

+71
-13
lines changed

DESCRIPTION

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,5 +32,5 @@ URL: https://future.batchtools.futureverse.org, https://github.com/futureverse/f
3232
BugReports: https://github.com/futureverse/future.batchtools/issues
3333
Language: en-US
3434
Encoding: UTF-8
35-
RoxygenNote: 7.3.2
35+
RoxygenNote: 7.3.3
3636
Roxygen: list(markdown = TRUE)

R/batchtools_slurm.R

Lines changed: 31 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -46,11 +46,40 @@ print.BatchtoolsSlurmFutureBackend <- function(x, ...) {
4646
#' This template and the built-in [batchtools::makeClusterFunctionsSlurm()]
4747
#' have been verified to work on a few different Slurm HPC clusters;
4848
#'
49-
#' 1. Slurm 21.08.4, Rocky 8 Linux, NFS global filesystem (August 2025)
50-
#' 2. Slurm 22.05.11, Rocky 8 Linux, NFS global filesystem (August 2025)
49+
#' 1. Slurm 21.08.4, Rocky Linux 8, NFS global filesystem (August 2025)
50+
#' 2. Slurm 22.05.11, Rocky Linux 8, NFS global filesystem (August 2025)
5151
#' 3. Slurm 23.02.6, Ubuntu 24.04 LTS, NFS global filesystem (August 2025)
52+
#' 4. Slurm 24.11.3, AlmaLinux 9, Lustre global filesystem (September 2025)
5253
#'
5354
#'
55+
#' @section Known issue "Error Future of class BatchtoolsSlurmFuture expired":
56+
#'
57+
#' Some users report (e.g. Issue [#74](https://github.com/futureverse/future.batchtools/issues/74), Discussion [#810](https://github.com/futureverse/future/discussions/810))
58+
#' that they fail to launch futures on their Slurm clusters using
59+
#' `plan(batchtools_slurm)`. When attempted, these futures fail with an
60+
#' error on the "future being expired". Specifically, the error received is:
61+
#'
62+
#' ```
63+
#' Error: Future (<unnamed-1>) of class BatchtoolsSlurmFuture expired, which indicates
64+
#' that it crashed or was killed. No log output file exist (at the moment)
65+
#' In addition: Warning messages:
66+
#' 1: batchtools::waitForJobs(..., timeout = 2592000) returned FALSE
67+
#' 2: In delete.BatchtoolsFuture(future) :
68+
#' Will not remove batchtools registry, because the status of the batchtools was
69+
#' 'error', 'defined', 'expired', 'submitted'
70+
#' ```
71+
#'
72+
#' We suspect this is related to how some Slurm schedulers provision jobs.
73+
#' But, because I cannot reproduce this on any of the three Slurm clusters
74+
#' I have access to, it is hard for me to troubleshoot and fix this myself.
75+
#' So, I need your help to figure this one out. If you get this error, please
76+
#' get in touch, preferably by opening an issue at
77+
#' <https://github.com/futureverse/future.batchtools/issues> and share what
78+
#' version of **future.batchtools** you have installed and what version of
79+
#' Slurm (`sbatch --version`) your system have. Then we take it from there.
80+
#' Thank you.
81+
#'
82+
#'
5483
#' @examplesIf interactive()
5584
#' library(future)
5685
#'

man/batchtools_bash.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_lsf.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_multicore.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_openlava.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_sge.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_slurm.Rd

Lines changed: 32 additions & 3 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/batchtools_torque.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

man/future.batchtools.Rd

Lines changed: 1 addition & 1 deletion
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

0 commit comments

Comments
 (0)