Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removes no such file or directory messages #2146

Conversation

HenryRWinterbottom
Copy link
Contributor

@HenryRWinterbottom HenryRWinterbottom commented Dec 12, 2023

Description

This PR addresses issue #1252. The following is accomplished:

  • A check for the existence of a specified file is made prior to attempting to use it in the respective GSI ncdiag file concatenation;
  • The issues raised by the shellcheck test are resolved; where exceptions are made but no relevant, the respective check is disabled.

Type of change

  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO

How has this been tested?

A set of files, replicating the respective GSI ncdiag files, is created. The respective files are listed here. Files were selectively removed and the script sub-section was executed to verify that the erroneous messages, raising issue #1252 no longer raised the specified messages.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • I have made corresponding changes to the documentation if necessary

@HenryRWinterbottom HenryRWinterbottom marked this pull request as ready for review December 12, 2023 19:19
Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update to address No such file or directory in scripts/exglobal_diag.sh is taken care of, as well as some additional shellcheck warning fixes (good). Surprised this script hasn't been touched earlier and had shellcheck stuff taken care of...oh well, fun for you!

Left a few comments, one of which involves even more shellcheck warning fixes. Thanks for working on this @HenryWinterbottom-NOAA !

scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
@KateFriedman-NOAA
Copy link
Member

@HenryWinterbottom-NOAA Have all of the scripts referenced in the main bugzilla description of #1252 been examined for "No such" statements and resolved if they still have them? If not (totally fine btw!), then please remove the "Resolves" statement so this PR doesn't close the associated issue just yet. Yourself or another developer will need to check the other jobs and confirm the issue is resolved before closing it...which will be a bit tricky for some jobs like the MOS jobs since we can't run them in our rocoto mesh (even after PR #2148 goes in). Thanks!

scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
scripts/exglobal_diag.sh Outdated Show resolved Hide resolved
HenryRWinterbottom and others added 10 commits December 14, 2023 08:07
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
@emcbot emcbot added CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion and removed CI-Orion-Ready **CM use only** PR is ready for CI testing on Orion labels Dec 20, 2023
@emcbot
Copy link

emcbot commented Dec 20, 2023

CI Update on Hera at 12/20/23 08:00:53 PM
============================================
Cloning and Building global-workflow PR: 2146
with PID: 288108 on host: hfe05

@emcbot
Copy link

emcbot commented Dec 20, 2023

CI Update on Orion at 12/20/23 02:00:55 PM
============================================
Cloning and Building global-workflow PR: 2146
with PID: 209328 on host: Orion-login-1

@emcbot emcbot added CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress and removed CI-Hera-Building **Bot use only** CI testing is cloning/building on Hera labels Dec 20, 2023
@emcbot
Copy link

emcbot commented Dec 20, 2023

Automated global-workflow Testing Results:

Machine: Hera
Start: Wed Dec 20 20:05:42 UTC 2023 on hfe05
---------------------------------------------------
Build: Completed at 12/20/23 08:55:56 PM
Case setup: Completed for experiment C48_ATM_c24df27d
Case setup: Completed for experiment C48_S2SW_c24df27d
Case setup: Completed for experiment C48_S2SWA_gefs_c24df27d
Case setup: Completed for experiment C96C48_hybatmDA_c24df27d
Case setup: Completed for experiment C96_atm3DVar_c24df27d

@emcbot emcbot added CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress and removed CI-Orion-Building **Bot use only** CI testing is cloning/building on Orion labels Dec 20, 2023
@emcbot
Copy link

emcbot commented Dec 20, 2023

Automated global-workflow Testing Results:

Machine: Orion
Start: Wed Dec 20 14:03:31 CST 2023 on Orion-login-1.HPC.MsState.Edu
---------------------------------------------------
Build: Completed at 12/20/23 02:57:13 PM
Case setup: Completed for experiment C48_ATM_c24df27d
Case setup: Completed for experiment C48_S2SWA_gefs_c24df27d
Case setup: Completed for experiment C48_S2SW_c24df27d
Case setup: Completed for experiment C96_atm3DVar_c24df27d
Case setup: Completed for experiment C96C48_hybatmDA_c24df27d

@emcbot emcbot added CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed and removed CI-Hera-Running **Bot use only** CI testing on Hera for this PR is in-progress labels Dec 20, 2023
@emcbot
Copy link

emcbot commented Dec 20, 2023

Experiment C96C48_hybatmDA_c24df27d  *** FAILED *** on Hera
Experiment C96C48_hybatmDA_c24df27d  with 1 tasks failed at 12/20/23 09:36:17 PM
Error logs:
/scratch1/NCEPDEV/global/Terry.McGuinness/GFS_CI_ROOT/PR/2146/RUNTESTS/COMROT/C96C48_hybatmDA_c24df27d/logs/2021122100/enkfgdasediag.log

@emcbot emcbot added CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed and removed CI-Orion-Running **Bot use only** CI testing on Orion for this PR is in-progress labels Dec 20, 2023
@emcbot
Copy link

emcbot commented Dec 20, 2023

Experiment C96C48_hybatmDA_c24df27d  *** FAILED *** on Orion
Experiment C96C48_hybatmDA_c24df27d  with 1 tasks failed at 12/20/23 03:42:19 PM
Error logs:
/work2/noaa/stmp/GFS_CI_ROOT/ORION/PR/2146/RUNTESTS/COMROT/C96C48_hybatmDA_c24df27d/logs/2021122100/enkfgdasediag.log

Co-authored-by: Walter Kolczynski - NOAA <Walter.Kolczynski@noaa.gov>
@WalterKolczynski-NOAA
Copy link
Contributor

@HenryWinterbottom-NOAA Please test this on your own on at least one machine before we run CI again. I don't want to do an iterative back-and-forth if there are more issues.

@WalterKolczynski-NOAA
Copy link
Contributor

@HenryWinterbottom-NOAA Have you successfully tested this so I can try the CI on it?

@HenryRWinterbottom
Copy link
Contributor Author

@WalterKolczynski-NOAA I am working on it now.

@WalterKolczynski-NOAA
Copy link
Contributor

Will revisit this later

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI-Hera-Failed **Bot use only** CI testing on Hera for this PR has failed CI-Orion-Failed **Bot use only** CI testing on Orion for this PR has failed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants