regression test : noresm2_5_alpha09a + dev1.7.1.2

[TomasTorsvik]

NorESM: noresm2_5_alpha09a
BLOM: dev1.7.1.2

Baseline: noresm2_5_alpha09

Summary report:

  FAIL ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel
  DIFF ERR_Ld3.TL319_tn14.NOIIAJRAOC.betzy_intel
  DIFF ERS_Ld3.T62_tn14.NOINYOC.betzy_intel
  DIFF ERS_Ld3.T62_tn14_wtn14nw.NOINY_WW3.betzy_intel.blom-wavice
  FAIL ERS_Ld3.T62_tn21.NOINY.betzy_intel
  DIFF ERS_Ld3.TL319_tn05.NOIIAJRA.betzy_intel
  DIFF SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel

---

Fail report:

    FAIL ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel NLCOMP
    FAIL ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel COMPARE_base_rest
    FAIL ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel BASELINE noresm2_5_alpha09: ERROR BFAIL some baseline files were missing
    FAIL ERR_Ld3.TL319_tn14.NOIIAJRAOC.betzy_intel NLCOMP
    FAIL ERR_Ld3.TL319_tn14.NOIIAJRAOC.betzy_intel BASELINE noresm2_5_alpha09: ERROR BFAIL baseline directory '/cluster/shared/noresm/noresm_baselines/blom_develop/noresm2_5_alpha09/ERR_Ld3.TL319_tn14.NOIIAJRAOC.betzy_intel' does not exist
    FAIL ERR_Ld3.TL319_tn14.NOIIAJRAOC.betzy_intel TPUTCOMP Could not get default throughput
    FAIL ERS_Ld3.T62_tn14.NOINYOC.betzy_intel NLCOMP
    FAIL ERS_Ld3.T62_tn14.NOINYOC.betzy_intel BASELINE noresm2_5_alpha09: DIFF
    FAIL ERS_Ld3.T62_tn14_wtn14nw.NOINY_WW3.betzy_intel.blom-wavice NLCOMP
    FAIL ERS_Ld3.T62_tn14_wtn14nw.NOINY_WW3.betzy_intel.blom-wavice BASELINE noresm2_5_alpha09: DIFF
    FAIL ERS_Ld3.T62_tn21.NOINY.betzy_intel NLCOMP
    FAIL ERS_Ld3.T62_tn21.NOINY.betzy_intel RUN time=28
    FAIL ERS_Ld3.TL319_tn05.NOIIAJRA.betzy_intel NLCOMP
    FAIL ERS_Ld3.TL319_tn05.NOIIAJRA.betzy_intel BASELINE noresm2_5_alpha09: ERROR BFAIL baseline directory '/cluster/shared/noresm/noresm_baselines/blom_develop/noresm2_5_alpha09/ERS_Ld3.TL319_tn05.NOIIAJRA.betzy_intel' does not exist
    FAIL SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel NLCOMP
    FAIL SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel BASELINE noresm2_5_alpha09: ERROR BFAIL baseline directory '/cluster/shared/noresm/noresm_baselines/blom_develop/noresm2_5_alpha09/SMS_D_Ld1.T62_tn14.NOINYOC.betzy_intel' does not exist

---

ERS_Ld3.T62_tn21.NOINY.betzy_intel: RUN error

ERROR: CICE n, mesh_lon , lon, diff_lon =      100    250.6063216750047      -109.5025760238913             0.10890D+00
  (abort_ice)ABORTED: 
  (abort_ice) called from ice_mesh_mod.F90
  (abort_ice) line number          641
  (abort_ice) error =  ice_mesh_check:
  ERROR: (abort_ice) ice_mesh_check:

---

ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel: COMPARE_base_rest error

• ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel.GC.20250220_113136_axicuo.blom.hbgcd.0001-01-03.nc.base.cprnc.out

SUMMARY of cprnc:
 A total number of    147 fields were compared
          of which     89 had non-zero differences
               and      9 had differences in fill patterns
               and      0 had different dimension sizes
               and      0 had different data types
 A total number of      0 fields could not be analyzed
 A total number of      0 time-varying fields on file 1 were not found on file 2.
 A total number of      0 time-constant fields on file 1 were not found on file 2.
 A total number of      0 time-varying fields on file 2 were not found on file 1.
 A total number of      0 time-constant fields on file 2 were not found on file 1.
  diff_test: the two files seem to be DIFFERENT 

• ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel.GC.20250220_113136_axicuo.blom.hd.0001-01-03.nc.base.cprnc.out

SUMMARY of cprnc:
 A total number of    115 fields were compared
          of which    104 had non-zero differences
               and     11 had differences in fill patterns
               and      0 had different dimension sizes
               and      0 had different data types
 A total number of      2 fields could not be analyzed
 A total number of      0 time-varying fields on file 1 were not found on file 2.
 A total number of      0 time-constant fields on file 1 were not found on file 2.
 A total number of      0 time-varying fields on file 2 were not found on file 1.
 A total number of      0 time-constant fields on file 2 were not found on file 1.
  diff_test: the two files seem to be DIFFERENT

• ERP_Ld3_P256.T62_tn14.NOINYOC.betzy_intel.GC.20250220_113136_axicuo.cpl.hi.0001-01-04-00000.nc.base.cprnc.out

SUMMARY of cprnc:
 A total number of    236 fields were compared
          of which     87 had non-zero differences
               and      0 had differences in fill patterns
               and      0 had different dimension sizes
               and      0 had different data types
 A total number of      0 fields could not be analyzed
 A total number of      0 time-varying fields on file 1 were not found on file 2.
 A total number of      0 time-constant fields on file 1 were not found on file 2.
 A total number of      0 time-varying fields on file 2 were not found on file 1.
 A total number of      0 time-constant fields on file 2 were not found on file 1.
  diff_test: the two files seem to be DIFFERENT

[jmaerz]

Hi @TomasTorsvik , thanks for linking from #513. Indeed, the first fail should be resolved via the fix NorESMhub/CMEPS#27. The second (ERP test) looks like something in BLOM that populates into iHAMOCC(?).

[TomasTorsvik]

Hi @jmaerz - the ERP test compares restarts with different processor counts, so I think it is likely due to handling of "ghost cells" somewhere in the code. Would be nice if this was working, but I don't think it should have a high priority to find a fix.