release/1.5.1: add fms@2023.03, site config updates round 3 #855

climbfuji · 2023-11-01T16:47:37Z

Summary

Add fms@2023.03 (see [INSTALL] fms/2023.02.01 #823 and links in there)
Update site configs (where necessary) and documentation for release 1.5.1 on:
- NOAA Parallel Works (AWS, Azure, Gcloud)
- JCSDA CI containers
- Casper
- Hercules, once again (switch to gcc@12 with mvapich2@2.3.7 to fix various bugs identified in ufs-weather-model testing)
- Documentation updates only: Nautilus, Orion, Gaea C4, Acorn, Hera, Jet, AWS Single Node AMI Red Hat 8

Testing

spack-stack installed successfully and tested to some extent on the above platforms
- Specifically, fms@2023.03 on Hercules with Intel and GNU
CI

Applications affected

None

Systems affected

See above

Dependencies

waiting on release/1.5.1: Add fms@2023.03 spack#363

Issue(s) addressed

Working towards #819

Checklist

This PR addresses one issue/problem/enhancement, or has a very good reason for not doing so.
These changes have been tested on the affected systems and applications.
All dependency PRs/issues have been resolved and this PR can be merged.

…into feature/rel_151_derecho_update

…s/sites/derecho/packages.yaml

…ster

…into feature/rel_151_derecho_update

…yaml

…into feature/rel_151_derecho_update

…pointer for testing

…pack-stack-1.5.1

…k-1.5.1

climbfuji · 2023-11-06T21:07:49Z

.gitmodules

  #branch = develop
  url = https://github.com/jcsda/spack
-  branch = release/1.5.1
+  branch = spack-stack-1.5.1


I already tagged the spack submodule, therefore point to the tag instead of the branch

srherbener

I noticed some changes in the new site config Linux documentation section that should be applied in the macOS section. I'm happy to make a new PR with those changes if that is how you would like to resolve them.

doc/source/NewSiteConfigs.rst

…section

climbfuji · 2023-11-06T22:30:06Z

@srherbener I addressed your comments and made the changes in the macOS section, please check.

srherbener

Thanks for updating the macOS documentation! Looks good.

* Clarifying directions in Generating new site configs (#791) * Change prod-util module to prod_util (#794) (#798) * Bumped bufr version to 12.0.1 (#797) * Workaround for spack-stack-1.5.0 on Hera: use new noavx512 install, add target 'haswell' * Update default atlas version to 0.35.0 * Update build variants for ecmwf-atlas * Update variants for ectrans * Remove deprecated variant cgal from ecmwf-atlas, since it conflicts with the replacement qhull for tesselation and since it leads to compilation errors in ecmwf-atlas with Intel * release/1.5.1: fix Intel container build (ectrans error), update Derecho documentation Bugfix/container ectrans fftw derecho docs (#821) * Comment out intel-oneapi-mkl in configs/containers/docker-ubuntu-intel-impi.yaml and fix wrong variant ~fftw for jedi-base-env in configs/containers/README.md * Fix incorrect variant name for mkl for package ectrans in configs/common/packages.yaml * Fix outdated instructions for Derecho in doc/source/PreConfiguredSites.rst * Update gsi-ncdiag version number in config. * Update fms default to 2023.02.01 * ESMF@8.5.0, MAPL@2.40.3 as defaults (#839) * update fms versions in unified-dev * update fms versions in ufs wm metapackage * update gftl-shared default to 1.6.1 * release/1.5.1: backport mpich4 workarounds for mapl@2.35.2 and mapl@2.40.3 (#842) * release/1.5.1: update site config for Hercules (gnu+mvapich2) (#849) * release/1.5.1: Update site configs for Derecho, Narwhal, Gaea C5, Discover, AWS ParallelCluster, S4 (#853) * release/1.5.1: add fms@2023.03, site config updates round 3 (#855) * Update site configs for NOAA Parallel Works * Update casper site config and build documentation * Update container specs in configs/containers/README.md * Update Hercules site config (gnu@12, mvapich2@2.3.7) * Update doc/source/PreConfiguredSites.rst for casper, hera, gaea-c4, jet * Add fms@2023.03 in spack submodule, add to unified-dev and skylab-dev templates * Update configs/containers after tagging spack submodule as spack-stack-1.5.1 * Update documentation for AWS AMI release 1.5.1 * Update macOS section in doc/source/NewSiteConfigs.rst to match Linux section --------- Co-authored-by: Nate Crossette <ncrossette@ucar.edu> Co-authored-by: Alex Richert <82525672+AlexanderRichert-NOAA@users.noreply.github.com> Co-authored-by: Stephen Herbener <32968781+srherbener@users.noreply.github.com> Co-authored-by: DavidHuber <David.Huber@noaa.gov> Co-authored-by: Alex Richert <alexander.richert@noaa.gov>

climbfuji added 16 commits October 19, 2023 19:41

Update site config for Derecho

0dfc779

Next attempt to update Derecho site config

97bc84e

Merge branch 'release/1.5.1' of https://github.com/jcsda/spack-stack …

3aac94a

…into feature/rel_151_derecho_update

Put libfabric and cray-pals modules back into MPI providers in config…

c80d7ce

…s/sites/derecho/packages.yaml

Next try to update crappy Derecho config

ae57896

Update documentation for spack-stack-1.5.1 install on AWS ParallelClu…

e42b291

…ster

Turn of ssl variant for Python for Derecho, Gaea C5, Narwhal

8a359cb

Merge branch 'release/1.5.1' of https://github.com/jcsda/spack-stack …

dab2a68

…into feature/rel_151_derecho_update

Add explicit variant external-xdr for hdf in configs/common/packages.…

945e448

…yaml

Progress on Derecho

a677421

Update doc/source/PreConfiguredSites.rst for discover

d545c79

More tweaks to documentation

9fa39a9

Final update for Derecho (gnu config)

3028d9b

Update documentation for spack-stack-1.5.1 on S4

203bbc0

Merge branch 'release/1.5.1' of https://github.com/jcsda/spack-stack …

944e2e6

…into feature/rel_151_derecho_update

Update site configs for NOAA Parallel Works

2d3c6f5

climbfuji self-assigned this Nov 1, 2023

climbfuji added the INFRA JEDI Infrastructure label Nov 1, 2023

Update casper site config and build documentation

739678f

This was referenced Nov 1, 2023

[INSTALL] fms/2023.02.01 #823

Closed

spack-stack release 1.5.1 #819

Closed

climbfuji added 9 commits November 2, 2023 10:37

Update container specs in configs/containers/README.md

705f9a5

Update Hercules site config (gcc@12, openmpi@4.1.4)

d45caae

Update casper site config, round2

3c1c5c3

Update doc/source/PreConfiguredSites.rst for casper, hera, gaea-c4, jet

3779e35

Yet another update for Hercules (gnu@12, mvapich2@2.3.7)

60c920a

Add fms@2023.03 in spack submodule, update .gitmodules and submodule …

243ec34

…pointer for testing

Update doc/source/PreConfiguredSites.rst for Nautilus, Hercules

cc4d3cb

Fix syntax error in configs/sites/hercules/packages.yaml

34b84d4

Add fms@2023.03 to unified-dev and skylab-dev templates

0891a31

climbfuji changed the title ~~release/1.5.1: site config updates round 3 (NOAA Parallel Works, ...)~~ release/1.5.1: add fms@2023.03, site config updates round 3 Nov 6, 2023

climbfuji mentioned this pull request Nov 6, 2023

release/1.5.1: Add fms@2023.03 JCSDA/spack#363

Merged

3 tasks

climbfuji added 3 commits November 6, 2023 08:47

Update .gitmodules and submodule pointer for spack after tagging as s…

5cafa9f

…pack-stack-1.5.1

Update configs/containers after tagging spack submodule as spack-stac…

65a8c88

…k-1.5.1

Update documentation for AWS AMI release 1.5.1

f7eeb85

climbfuji marked this pull request as ready for review November 6, 2023 21:06

climbfuji requested review from AlexanderRichert-NOAA, RatkoVasic-NOAA, natalie-perlin, srherbener and ulmononian November 6, 2023 21:07

climbfuji commented Nov 6, 2023

View reviewed changes

srherbener approved these changes Nov 6, 2023

View reviewed changes

doc/source/NewSiteConfigs.rst Show resolved Hide resolved

doc/source/NewSiteConfigs.rst Show resolved Hide resolved

doc/source/NewSiteConfigs.rst Show resolved Hide resolved

Update macOS section in doc/source/NewSiteConfigs.rst to match Linux …

4df571d

…section

srherbener approved these changes Nov 6, 2023

View reviewed changes

climbfuji merged commit 883ebcb into JCSDA:release/1.5.1 Nov 7, 2023

climbfuji deleted the feature/rel_151_siteconfigs_part3 branch November 7, 2023 03:06

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

release/1.5.1: add fms@2023.03, site config updates round 3 #855

release/1.5.1: add fms@2023.03, site config updates round 3 #855

Uh oh!

climbfuji commented Nov 1, 2023 •

edited

Loading

Uh oh!

climbfuji Nov 6, 2023

Uh oh!

srherbener left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

climbfuji commented Nov 6, 2023

Uh oh!

srherbener left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

release/1.5.1: add fms@2023.03, site config updates round 3 #855

release/1.5.1: add fms@2023.03, site config updates round 3 #855

Uh oh!

Conversation

climbfuji commented Nov 1, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Testing

Applications affected

Systems affected

Dependencies

Issue(s) addressed

Checklist

Uh oh!

climbfuji Nov 6, 2023

Choose a reason for hiding this comment

Uh oh!

srherbener left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

climbfuji commented Nov 6, 2023

Uh oh!

srherbener left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

climbfuji commented Nov 1, 2023 •

edited

Loading