Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add max wallclock time to machine files #330

Closed
phil-blain opened this issue Jul 4, 2019 · 3 comments
Closed

Add max wallclock time to machine files #330

phil-blain opened this issue Jul 4, 2019 · 3 comments

Comments

@phil-blain
Copy link
Member

I'm porting to one of our clusters which has a max wallclock time of 3 hours.
The base_suite has a few tests wihch use the "medium" option, which sets ICE_RUNLENGTH to 4 (4 hours), so I have to manually change configuration/scripts/options/set_env.medium from 4 to 3 before creating a test or a suite, or else it fails to submit.
I propose adding a setting to the env files, such as ICE_MACHINE_MAX_WALLCLOCK or similar, and modifying cice.batch such that the "batchtime" variable is capped to the value of ICE_MACHINE_MAX_WALLCLOCK.

@eclare108213
Copy link
Contributor

This seems like a good idea. There are issues like this more generally, e.g. some machines don't have enough processors to run some of the base_suite tests, so those return fails (I think). It would be nice to have a way of specifying ahead of time what the computing environment limitations are.

@apcraig
Copy link
Contributor

apcraig commented Aug 13, 2019

I am implementing machine limits on both total number of pes (tasks * threads) and the batch wall limit. Are there other constraints we want?

If some current machines have limits, let me know and I'll add them to the env machine files. For now, I'll just test on one of the machine I have access to with fake limits but won't check those limits in.

@apcraig
Copy link
Contributor

apcraig commented Aug 30, 2019

This is done with #349 and #356. MAXPES, MAXRUNLENGTH, and MAXTHREADS are options.

@apcraig apcraig closed this as completed Aug 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants