Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding atmw to the ort scripts #1747

Closed
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
1384bff
Update opnReqTest
SadeghTabas-NOAA May 8, 2023
b96766e
adding atmw
SadeghTabas-NOAA May 8, 2023
6a1ca23
Update dbg.sh
SadeghTabas-NOAA May 8, 2023
f908264
Update dcp.sh
SadeghTabas-NOAA May 8, 2023
318e278
adds atmw
SadeghTabas-NOAA May 8, 2023
156a401
adding atmw
SadeghTabas-NOAA May 8, 2023
ffad294
adds atmw
SadeghTabas-NOAA May 8, 2023
fdb63ba
adding atmw
SadeghTabas-NOAA May 8, 2023
6bb068d
Update rst.sh
SadeghTabas-NOAA May 9, 2023
c525c90
Update dbg.sh
SadeghTabas-NOAA May 9, 2023
db1560a
Update rst.sh
SadeghTabas-NOAA May 9, 2023
61d9050
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA May 9, 2023
71fbfee
Update rst.sh
SadeghTabas-NOAA May 9, 2023
0e8c5e4
Update rst.sh
SadeghTabas-NOAA May 11, 2023
cba748e
Update rst.sh
SadeghTabas-NOAA May 11, 2023
36508f9
Update rst.sh
SadeghTabas-NOAA May 12, 2023
370667c
Update rst.sh
SadeghTabas-NOAA May 12, 2023
d6971a0
Update rst.sh
SadeghTabas-NOAA May 12, 2023
6c33464
Update rst.sh
SadeghTabas-NOAA May 12, 2023
61ce7fc
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA May 16, 2023
e157361
Update dbg.sh
SadeghTabas-NOAA May 16, 2023
8d43a1a
Update rst.sh
SadeghTabas-NOAA May 16, 2023
96fd8cb
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
88270d2
Update rst.sh
SadeghTabas-NOAA May 17, 2023
37f968d
Update atmwav_control_noaero_p8
SadeghTabas-NOAA May 17, 2023
25619ef
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA May 17, 2023
8ab4e81
revert changes in atmwav_control_noaero_p8
SadeghTabas-NOAA May 17, 2023
50acc5b
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
36277b0
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
7be5a70
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
4c039c9
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
e4f9531
Update fhz.sh
SadeghTabas-NOAA May 17, 2023
7c2c418
Update dbg.sh
SadeghTabas-NOAA May 17, 2023
abf12b2
Update atmwav_control_noaero_p8
SadeghTabas-NOAA May 17, 2023
579af2d
Update dbg.sh
SadeghTabas-NOAA May 18, 2023
dff3db4
Update dbg.sh
SadeghTabas-NOAA May 24, 2023
20727dc
Update dbg.sh
SadeghTabas-NOAA May 24, 2023
e71fece
Update dbg.sh
SadeghTabas-NOAA May 24, 2023
b5c8b92
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA May 26, 2023
4bdfdc1
Update fhz.sh
SadeghTabas-NOAA May 28, 2023
cbd0d7c
Update atmwav_control_noaero_p8
SadeghTabas-NOAA May 28, 2023
643dab3
added CMP_DATAONLY variable for ORT FHZ test
SadeghTabas-NOAA May 28, 2023
f1871be
added CMP_DATAONLY variable for ORT FHZ test (default false)
SadeghTabas-NOAA May 28, 2023
b61f862
added CMEPS and WAVE restart file for ATMW ORT RST test
SadeghTabas-NOAA May 28, 2023
cf338d5
Update atmwav_control_noaero_p8
SadeghTabas-NOAA May 28, 2023
1000f5c
Update fhz.sh
SadeghTabas-NOAA May 28, 2023
d438484
Update fhz.sh
SadeghTabas-NOAA May 28, 2023
99908e0
Update control_run.IN
SadeghTabas-NOAA May 30, 2023
8872e2d
Update control_run.IN
SadeghTabas-NOAA May 30, 2023
825e300
Update control_run.IN
SadeghTabas-NOAA May 31, 2023
79fc749
Update atmwav_control_noaero_p8
SadeghTabas-NOAA May 31, 2023
33a3e9d
Update rst.sh
SadeghTabas-NOAA May 31, 2023
be9cebb
Update std.sh
SadeghTabas-NOAA May 31, 2023
0289c02
Update dbg.sh
SadeghTabas-NOAA May 31, 2023
012c25b
Update std.sh
SadeghTabas-NOAA Jun 1, 2023
95aed4d
Update std.sh
SadeghTabas-NOAA Jun 1, 2023
f42cdcb
resolving conflicts with recent PR
SadeghTabas-NOAA Jun 1, 2023
3ce29e4
resolving conflicts with recent PR
SadeghTabas-NOAA Jun 1, 2023
80fe382
Merge branch 'develop' into ATMW-ORT
SadeghTabas-NOAA Jun 1, 2023
bbf5a78
Update mpi.sh to account for atmw test
SadeghTabas-NOAA Jun 1, 2023
4b9056a
adding CMP_DATAONLY variable (default=false) for ORT tests
SadeghTabas-NOAA Jun 1, 2023
4dc2bce
Update rst.sh
SadeghTabas-NOAA Jun 1, 2023
c6b49f4
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA Jun 7, 2023
c03e559
Merge branch 'ufs-community:develop' into ATMW-ORT
SadeghTabas-NOAA Jun 12, 2023
07d3701
atmw ort log on hera
SadeghTabas-NOAA Jun 13, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions tests/default_vars.sh
Original file line number Diff line number Diff line change
Expand Up @@ -321,6 +321,7 @@ fi
WLCLK_dflt=30

export WLCLK=$WLCLK_dflt
export CMP_DATAONLY=false

export_fv3 ()
{
Expand Down
12 changes: 12 additions & 0 deletions tests/fv3_conf/control_run.IN
Original file line number Diff line number Diff line change
Expand Up @@ -24,6 +24,18 @@ else
SUFFIX=${BL_SUFFIX}
fi

# WAVE restart file for ATMW ORT tests
if [[ $CPLWAV == .true. ]]; then
if [[ $med_model == cmeps ]] && [[ $RUNTYPE == continue ]]; then
# CMEPS restart and pointer files
RFILE=ufs.atmw.cpl.r.${RESTART_FILE_SUFFIX_SECS}.nc
cp ../${DEP_RUN}${SUFFIX}/RESTART/${RFILE} .
ls -1 ${RFILE}>rpointer.cpl
fi
RFILE=ufs.atmw.ww3.r.${RESTART_FILE_SUFFIX_SECS}
cp ../${DEP_RUN}${SUFFIX}/${RFILE} .
fi

if [ $MODEL_INITIALIZATION = false ]; then
#read_inc and iau tests restart from fh=24
CURRDIR=`pwd`
Expand Down
412 changes: 412 additions & 0 deletions tests/logs/OpnReqTests_atmwav_control_noaero_p8_hera.log

Large diffs are not rendered by default.

2 changes: 2 additions & 0 deletions tests/opnReqTest
Original file line number Diff line number Diff line change
Expand Up @@ -153,6 +153,8 @@ run_opnReqTests() {
application=cpld
elif [[ $TEST_NAME =~ datm ]]; then
application=datm
elif [[ $TEST_NAME =~ atmw ]]; then
application=atmw
else
application=global
fi
Expand Down
18 changes: 18 additions & 0 deletions tests/opnReqTests/dbg.sh
Original file line number Diff line number Diff line change
Expand Up @@ -36,10 +36,28 @@ elif [[ $application == 'cpld' ]]; then
| sed -E "s/20210323\.060000\.out_pnt\.ww3/20210322\.090000\.out_pnt\.ww3/g" \
| sed -E "s/20210323\.060000\.out_grd\.ww3/20210322\.090000\.out_grd\.ww3/g" \
| sed -e "s/^ *//" -e "s/ *$//")
elif [[ $application == 'atmw' ]]; then
FHMAX=3
WW3RSTDTHR=3
DT_2_RST="$(printf "%02d" $(( ${WW3RSTDTHR}*3600 )))"
DAYS=0.125
NFHOUT_HF=1
RESTART_INTERVAL=${FHMAX}
RESTART_N=${FHMAX}
OUTPUT_FH="0 ${FHMAX}"
LIST_FILES=$(echo -n $LIST_FILES | sed -E "s/sfcf012/sfcf003/g" \
| sed -E "s/atmf012/atmf003/g" \
| sed -E "s/2021-03-22-64800/2021-03-22-32400/g" \
| sed -E "s/20210322\.180000/20210322\.090000/g" \
| sed -E "s/20210322\.180000\.out_pnt\.ww3/20210322\.090000\.out_pnt\.ww3/g" \
| sed -E "s/20210322\.180000\.out_grd\.ww3/20210322\.090000\.out_grd\.ww3/g" \
| sed -e "s/^ *//" -e "s/ *$//")

fi

source $PATHRT/opnReqTests/wrt_env.sh

cat <<EOF >>${RUNDIR_ROOT}/opnreq_test${RT_SUFFIX}.env
export WLCLK=${WLCLK}
export DT_2_RST=${DT_2_RST:-}
EOF
10 changes: 10 additions & 0 deletions tests/opnReqTests/dcp.sh
Original file line number Diff line number Diff line change
Expand Up @@ -37,6 +37,16 @@ elif [[ $application == 'cpld' ]]; then
INPES=$JNPES
JNPES=$temp
fi
elif [[ $application == 'atmw' ]]; then
if [[ $CI_TEST == 'true' ]]; then
INPES=3
JNPES=1
TASKS=$((INPES*JNPES + WRITE_GROUP*WRTTASK_PER_GROUP))
else
temp=$INPES
INPES=$JNPES
JNPES=$temp
fi
fi


Expand Down
7 changes: 7 additions & 0 deletions tests/opnReqTests/fhz.sh
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
set -eu
source $PATHRT/opnReqTests/std.sh


if [[ $application == 'global' ]]; then
FHZERO=3
LIST_FILES=$(echo -n $LIST_FILES | sed -E "s/phyf024.nc ?//g" \
Expand All @@ -20,6 +21,11 @@ elif [[ $application == 'cpld' ]]; then
echo "This test is not yet set up for the fhzero test, skipping..."
continue 1
fi
elif [[ $application == 'atmw' ]]; then
FHZERO=3
LIST_FILES=$(echo -n $LIST_FILES | sed -E "s/sfcf012.nc ?//g" \
| sed -E "s/atmf012.nc ?//g" \
| sed -e "s/^ *//" -e "s/ *$//")
else
echo "This test is not yet set up for the fhzero test, skipping..."
continue 1
Expand All @@ -29,4 +35,5 @@ source $PATHRT/opnReqTests/wrt_env.sh

cat <<EOF >>${RUNDIR_ROOT}/opnreq_test${RT_SUFFIX}.env
export FHZERO=${FHZERO}
export CMP_DATAONLY=true
EOF
11 changes: 11 additions & 0 deletions tests/opnReqTests/mpi.sh
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,17 @@ elif [[ $application == 'regional' ]]; then
elif [[ $application == 'cpld' ]]; then
echo "Coupled application not yet implemented for mpi, skipping..."
continue 1
elif [[ $application == 'atmw' ]]; then
if [ $CI_TEST == 'true' ]; then
INPES=2
JNPES=2
else
JNPES=$((JNPES/2))
fi
WRITE_GROUP=2
WRTTASK_PER_GROUP=12
TASKS=$(( INPES*JNPES + WRITE_GROUP*WRTTASK_PER_GROUP ))
NODES=$(((TASKS+TPN-1)/TPN))
fi


Expand Down
11 changes: 11 additions & 0 deletions tests/opnReqTests/rst.sh
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,16 @@ elif [[ $application == 'cpld' ]]; then
RESTART_FILE_PREFIX="${SYEAR}${SMONTH}${SDAY}.$(printf "%02d" $(( SHOUR + FHROT )))0000"
RESTART_FILE_SUFFIX_SECS="${SYEAR}-${SMONTH}-${SDAY}-$(printf "%05d" $(( (SHOUR + FHROT)* 3600 )))"
RUN_BEG="${SYEAR}${SMONTH}${SDAY} $(printf "%02d" $(( ${FHROT}+${SHOUR} )))0000"
elif [[ $application == 'atmw' ]]; then
FHROT=$(( FHMAX/2 ))
WW3RSTDTHR=6
DT_2_RST="$(printf "%02d" $(( ${WW3RSTDTHR}*3600 )))"
RUNTYPE='continue'
USE_RESTART_TIME='.true.'
RESTART_N=$(( FHMAX - FHROT ))
RESTART_FILE_PREFIX="${SYEAR}${SMONTH}${SDAY}.$(printf "%02d" $(( SHOUR + FHROT )))0000"
RESTART_FILE_SUFFIX_SECS="${SYEAR}-${SMONTH}-${SDAY}-$(printf "%05d" $(( (SHOUR + FHROT)* 3600 )))"
RUN_BEG="${SYEAR}${SMONTH}${SDAY} $(printf "%02d" $(( ${FHROT}+${SHOUR} )))0000"
fi

WARM_START=.T.
Expand All @@ -59,6 +69,7 @@ source $PATHRT/opnReqTests/wrt_env.sh

cat <<EOF >>${RUNDIR_ROOT}/opnreq_test${RT_SUFFIX}.env
export FHROT=${FHROT}
export DT_2_RST=${DT_2_RST:-}
export RESTART_FILE_PREFIX=${RESTART_FILE_PREFIX}
export NSTF_NAME=${NSTF_NAME}
export CICERUNTYPE=${CICERUNTYPE:-}
Expand Down
10 changes: 10 additions & 0 deletions tests/opnReqTests/std.sh
Original file line number Diff line number Diff line change
Expand Up @@ -32,6 +32,16 @@ elif [[ $application == 'cpld' ]]; then
fi
RESTART_N=$(( FHMAX/2 ))
RESTART_INTERVAL="${RESTART_N} -1"
elif [[ $application == 'atmw' ]]; then
if [ $CI_TEST == 'true' ]; then
INPES=3
JNPES=8
WRTTASK_PER_GROUP=6
TASKS=$((INPES*JNPES + WRITE_GROUP*WRTTASK_PER_GROUP))
NODES=$(((TASKS+TPN-1)/TPN))
fi
RESTART_N=$(( FHMAX/2 ))
RESTART_INTERVAL="${RESTART_N} -1"
fi

#outdated (test $CI_TEST == 'true') && source $PATHRT/opnReqTests/cmp_proc_bind.sh
Expand Down
8 changes: 8 additions & 0 deletions tests/opnReqTests/thr.sh
Original file line number Diff line number Diff line change
Expand Up @@ -51,6 +51,14 @@ elif [[ $application == 'cpld' ]]; then
continue 1
fi
fi
elif [[ $application == 'atmw' ]]; then
if [[ $CI_TEST == 'true' ]]; then
INPES=5
JNPES=11
WRTTASK_PER_GROUP=10
TASKS=$((INPES*JNPES + WRITE_GROUP*WRTTASK_PER_GROUP))
NODES=$(((TASKS+TPN-1)/TPN))
fi
fi


Expand Down
6 changes: 5 additions & 1 deletion tests/rt_utils.sh
Original file line number Diff line number Diff line change
Expand Up @@ -351,7 +351,11 @@ check_results() {
printf ".......ALT CHECK.." >> ${RT_LOG}
printf ".......ALT CHECK.."
if [[ ${MACHINE_ID} =~ orion || ${MACHINE_ID} =~ hera || ${MACHINE_ID} =~ gaea || ${MACHINE_ID} =~ jet || ${MACHINE_ID} =~ cheyenne ]] ; then
nccmp -d -f -g -B --Attribute=checksum --warn=format ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/${i} ${RUNDIR}/${i} > ${i}_nccmp.log 2>&1 && d=$? || d=$?
if [[ $CMP_DATAONLY == false ]]; then
nccmp -d -f -g -B --Attribute=checksum --warn=format ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/${i} ${RUNDIR}/${i} > ${i}_nccmp.log 2>&1 && d=$? || d=$?
else
nccmp -d -f -B --Attribute=checksum --warn=format ${RTPWD}/${CNTL_DIR}_${RT_COMPILER}/${i} ${RUNDIR}/${i} > ${i}_nccmp.log 2>&1 && d=$? || d=$?
fi
if [[ $d -ne 0 && $d -ne 1 ]]; then
echo "....ERROR" >> ${RT_LOG}
echo "....ERROR"
Expand Down