Skip to content

Future.batchtools on CLAIX HPC #98

@zeratoss

Description

@zeratoss

Continuing our discussion from https://bsky.app/profile/henrikbengtsson.bsky.social/post/3lwi7zkk5cc23

Rocky Linux 9.6 (Blue Onyx)
slurm 22.05.10
HPC info https://help.itc.rwth-aachen.de/service/rhr4fjjutttf/article/fbd107191cf14c4b8307f44f545cf68a/
future.batchtools_0.20.0-9017 future_1.67.0

> library(future.batchtools)
Loading required package: parallelly
Loading required package: future
> plan(batchtools_slurm)
> f <- future(Sys.info())
> value(f)
Error: Future (<unnamed-1>) of class BatchtoolsSlurmFuture expired, which indicates that it crashed or was killed.
Post-mortem details:
Future state: ‘running’
Batchtools status: ‘defined’, ‘expired’, ‘submitted’
Slurm job ID: [n=1] ‘60957343’
Slurm 'squeue' job status: <empty>
Slurm 'sacct' job status: 60957343|FAILED|1:0
The last few lines of the logged output:
Session information:
- timestamp: 2025-09-12 10:48:56+0200
- hostname: r23m0148.hpc.itc.rwth-aachen.de
which: no Rscript in (/home/mz637064/.cargo/bin:/cvmfs/software.hpc.rwth.de/Linux/RH9/x86_64/intel/sapphirerapids/software/impi/2021.13.0-intel-compilers-2024.2.0/mpi/2021.13/libfabric/bin:/cvmfs/software.hpc.rwth.de/Linux/RH9/x86_64/intel/sapphirerapids/software/impi/2021.13.0-intel-compilers-2024.2.0/mpi/2021.13/bin:/cvmfs/software.hpc.rwth.de/Linux/RH9/x86_64/intel/sapphirerapids/software/intel-compilers/2024.2.0/compiler/2024.2/bin:/cvmfs/software.hpc.rwth.de/Linux/RH9/x86_64/intel/sapphirerapids/softw
In addition: Warning messages:
1: batchtools::waitForJobs(..., timeout = 2592000) returned FALSE 
2: In delete.BatchtoolsFuture(future) :
  Will not remove batchtools registry, because the status of the batchtools was ‘error’, ‘defined’, ‘expired’, ‘submitted’ and future backend argument 'delete' is ‘on-success’: ‘/rwthfs/rz/cluster/hpcwork/p0020567/analysis/paul_analysis/.future/20250912_104823-KfLJpM/batchtools_1317387372’

So the batchtools parsing issue seems to be resolved. I am not sure what this no Rscript ithing is about as Rscript is definetly in the PATH:

Sys.which("Rscript")
>"/hpcwork/p0020567/enviroments/rslurm/bin/Rscript"

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions