Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Autogenerate Executors in Configuration file #1366

Open
shahzebsiddiqui opened this issue Feb 2, 2023 · 1 comment
Open

Autogenerate Executors in Configuration file #1366

shahzebsiddiqui opened this issue Feb 2, 2023 · 1 comment
Assignees
Labels
new feature New Feature in buildtest such as command line or improvement to buildspec

Comments

@shahzebsiddiqui
Copy link
Member

@ireed based on our discussion in the HPC validation mini series, you mentioned the need for auto-generating configuration such as slurm partition that can just be picked up by buildtest.

I think this feature request is reasonable.

We need to auto-generate executors for all executor types i take it local, slurm, lsf, pbs, cobalt. Potentially we can have a command buildtest config executors discover that can detect new executors, now we can have buildtest automatically update the configuration file.

I take it if an executor is already defined, then down redefine a new executor

@ireed
Copy link

ireed commented Feb 6, 2023

@shahzebsiddiqui the main thing that needs to be detected for cloud systems is the specs. For a given node, i dont know things such as the expected number of cores, gpus, interconnects etc. Commands such as lshw may not be reliable due to potential HW failure and hypervisor issues.

@shahzebsiddiqui shahzebsiddiqui self-assigned this Feb 6, 2023
@shahzebsiddiqui shahzebsiddiqui added the new feature New Feature in buildtest such as command line or improvement to buildspec label Mar 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new feature New Feature in buildtest such as command line or improvement to buildspec
Projects
No open projects
Status: No status
Development

No branches or pull requests

2 participants