Skip to content

[Documentation] Explain the differences between the TestClusterExecutor and the SlurmClusterExecutor and the FluxClusterExecutor #922

@jan-janssen

Description

@jan-janssen

For the TestClusterExecutor this is the case, because the subprocess interface does not provide any dependency management. It waits until all dependent tasks are completed before the next step is submitted:
https://github.com/pyiron/executorlib/blob/main/src/executorlib/task_scheduler/file/spawner_subprocess.py#L49

In contrast to this the FluxClusterExecutor and the SlurmClusterExecutor use the job scheduler for dependency management, so for those there is no need to wait:
https://github.com/pyiron/executorlib/blob/main/src/executorlib/task_scheduler/file/spawner_pysqa.py#L70

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions