run all output scripts on one slurm, improve logging #1340
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Purpose of this PR
--vanilla
toRscript
calls within GAMS to suppress hundreds ofGlobal .Rprofile loaded! (R version 4.1.2 (2021-11-01))
lines in the logs.output.R
, if you selectsingle
but then choose more than one output script (say:reporting
+rds_report
+emulator
for a coupled run), they were all run on separateslurm
jobs, sometimes interfering with each other, or one script needed the output of the other, which creates a big mess. I propose to run eachoutputdir
in one slurm job, but all the scripts selected one after the other in this one job. This allows you to actually select a chain of output scripts that need each other, instead of having them interfere with each other.scripts/input/exoGAINSAirpollutants.R
, improve the logging which file is used.start.R
, also look intoconfig
if you find the config file there. I struggled quite a bit with the warning that the file could not be found, although it was clearly in the config folder, except I forgot to add theconfig/
part in the command line. Make sure this does not happen anymore to anyone.Type of change
Checklist:
remind2
FAIL 0
in the output ofmake test
)