Following #354, if a CDDS workflow does not succeed, it must be stopped and cleaned before attempting to re-run CMEW.
Acceptance criteria
- Given a working CMEW workflow
- When a CDDS workflow fails
- And the
standardise_model_data job fails
- Then the
housekeeping job stops and cleans all CDDS workflows
Note: The housekeeping task currently runs at the end of the workflow, but could be run after restructure_dirs (since it only cleans up CDDS-related data), and will need to be run for each dataset.
Following #354, if a CDDS workflow does not succeed, it must be stopped and cleaned before attempting to re-run CMEW.
Acceptance criteria
standardise_model_datajob failshousekeepingjob stops and cleans all CDDS workflowsNote: The
housekeepingtask currently runs at the end of the workflow, but could be run afterrestructure_dirs(since it only cleans up CDDS-related data), and will need to be run for eachdataset.