Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Refactor UFS-DA ATM ens component to use python g-w #1373

Merged
Merged
Show file tree
Hide file tree
Changes from 10 commits
Commits
Show all changes
55 commits
Select commit Hold shift + click to select a range
0b28a7f
refactor UFS-DA atm ens to use python g-w (#1313)
RussTreadon-NOAA Mar 4, 2023
ccc418a
convert UFS-DA ATM ens increment to UFS model readable format (#1313)
RussTreadon-NOAA Mar 6, 2023
10670fd
correct pynorms errors in atmens_analysis.py (#1313)
RussTreadon-NOAA Mar 6, 2023
32e1072
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 7, 2023
13acd1e
update UFS-DA ATM ens ecen and esfc job dependencies (#1313)
RussTreadon-NOAA Mar 7, 2023
efb80f9
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 8, 2023
a0d1d8d
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 10, 2023
421215b
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 13, 2023
b80a547
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 15, 2023
8adfaf7
clean up comin variables in UFS-DA ens jobs, remove DATA from ens dia…
RussTreadon-NOAA Mar 17, 2023
6e686c2
export gPDY in UFS-DA ens run and finalize jobs (#1313)
RussTreadon-NOAA Mar 17, 2023
ecf37b6
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 17, 2023
d60a17e
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 21, 2023
c74c8ad
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 22, 2023
f175271
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 22, 2023
be894fa
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 23, 2023
3c4e445
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 24, 2023
0db481e
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 27, 2023
f1bedf5
update UFS-DA ATM ens crtm and fix stage (#1313)
RussTreadon-NOAA Mar 27, 2023
036b1f0
import additional functions from pygw.yaml_file in atmens_analysis.py…
RussTreadon-NOAA Mar 27, 2023
f24dfd1
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 28, 2023
cd75914
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 28, 2023
78cdb39
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 29, 2023
07e4e29
sync UFS-DA ATM ens jobs and atmens_analysis task with g-w python (#1…
RussTreadon-NOAA Mar 30, 2023
e31aa75
address linter errors in JGLOBAL_ATMENS_ANALYSIS_RUN (#1313)
RussTreadon-NOAA Mar 30, 2023
473e94b
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 31, 2023
48411bd
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Mar 31, 2023
9d5d831
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 4, 2023
5f42c8b
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 4, 2023
9b4fbbf
remove RESTART from ensemble member background run directory path (#1…
RussTreadon-NOAA Apr 5, 2023
169cc2e
Merge branch 'develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 12, 2023
b0fbad2
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 12, 2023
f5ced68
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 15, 2023
00baac5
update atmens python scripting (#1313)
RussTreadon-NOAA Apr 17, 2023
b3f3bde
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 17, 2023
4d328e3
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 17, 2023
b0741ea
Merge branch 'develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 18, 2023
0335389
update sha-bang in atmens config files, correct atmens errors in work…
RussTreadon-NOAA Apr 19, 2023
c48dd66
clean up comments in jobs and scripts (#1313)
RussTreadon-NOAA Apr 19, 2023
f902370
collect bkg member directories in list for mkdir (#1313)
RussTreadon-NOAA Apr 19, 2023
d587193
Remove Filehandler from get_bkg_dict (#1313)
RussTreadon-NOAA Apr 19, 2023
aa162d0
Streamline script creating list of ensemble backgrounds (#1313)
RussTreadon-NOAA Apr 19, 2023
8746b19
correct pycodestyle errors (#1313)
RussTreadon-NOAA Apr 19, 2023
6b66312
define ftype before use (#1313)
RussTreadon-NOAA Apr 19, 2023
4b61129
move JEDI executable link to analysis.py (#1313)
RussTreadon-NOAA Apr 19, 2023
9ad17f4
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 19, 2023
ddfc811
correctly set cycledefs for gfs atmanlinit (#1313)
RussTreadon-NOAA Apr 20, 2023
d351695
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 20, 2023
0aab132
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 20, 2023
30db276
remove FV3JEDI_FIX from atmanl and atmensanl config files (#1313)
RussTreadon-NOAA Apr 20, 2023
8056bf9
streamline creation of ensemble member analysis directories (#1313)
RussTreadon-NOAA Apr 20, 2023
812cb46
add TODO for MPMD or parallelize with mpi4py in atmens_analysis.py (#…
RussTreadon-NOAA Apr 20, 2023
6962445
remove trailing whitespace in atmens_analysis.py comment (#1313)
RussTreadon-NOAA Apr 20, 2023
77bc6dc
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 21, 2023
07c052f
Merge branch 'NOAA-EMC:develop' into feature/refactor_jediens
RussTreadon-NOAA Apr 21, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion env/CONTAINER.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "aeroanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen efcs epos"
Expand Down
12 changes: 6 additions & 6 deletions env/HERA.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "aeroanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen efcs epos"
Expand Down Expand Up @@ -61,17 +61,17 @@ elif [[ "${step}" = "atmanalrun" ]]; then
[[ ${NTHREADS_ATMANAL} -gt ${nth_max} ]] && export NTHREADS_ATMANAL=${nth_max}
export APRUN_ATMANAL="${launcher} -n ${npe_atmanalrun}"

elif [[ "${step}" = "atmensanalrun" ]]; then
elif [[ "${step}" = "atmensanlrun" ]]; then

export CFP_MP=${CFP_MP:-"YES"}
export USE_CFP=${USE_CFP:-"YES"}
export APRUNCFP="${launcher} -n \$ncmd ${mpmd_opt}"

nth_max=$((npe_node_max / npe_node_atmensanalrun))
nth_max=$((npe_node_max / npe_node_atmensanlrun))

export NTHREADS_ATMENSANAL=${nth_atmensanalrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANAL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANAL=${nth_max}
export APRUN_ATMENSANAL="${launcher} -n ${npe_atmensanalrun}"
export NTHREADS_ATMENSANL=${nth_atmensanlrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANL=${nth_max}
export APRUN_ATMENSANL="${launcher} -n ${npe_atmensanlrun}"

elif [[ "${step}" = "aeroanlrun" ]]; then

Expand Down
12 changes: 6 additions & 6 deletions env/JET.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen efcs epos"
echo "postsnd awips gempak"
Expand Down Expand Up @@ -51,13 +51,13 @@ elif [[ "${step}" = "atmanalrun" ]]; then
[[ ${NTHREADS_ATMANAL} -gt ${nth_max} ]] && export NTHREADS_ATMANAL=${nth_max}
export APRUN_ATMANAL="${launcher} ${npe_atmanalrun}"

elif [[ "${step}" = "atmensanalrun" ]]; then
elif [[ "${step}" = "atmensanlrun" ]]; then

nth_max=$((npe_node_max / npe_node_atmensanalrun))
nth_max=$((npe_node_max / npe_node_atmensanlrun))

export NTHREADS_ATMENSANAL=${nth_atmensanalrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANAL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANAL=${nth_max}
export APRUN_ATMENSANAL="${launcher} ${npe_atmensanalrun}"
export NTHREADS_ATMENSANL=${nth_atmensanlrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANL=${nth_max}
export APRUN_ATMENSANL="${launcher} ${npe_atmensanlrun}"

elif [[ "${step}" = "anal" ]]; then

Expand Down
12 changes: 6 additions & 6 deletions env/ORION.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "aeroanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen efcs epos"
Expand Down Expand Up @@ -61,17 +61,17 @@ elif [[ "${step}" = "atmanalrun" ]]; then
[[ ${NTHREADS_ATMANAL} -gt ${nth_max} ]] && export NTHREADS_ATMANAL=${nth_max}
export APRUN_ATMANAL="${launcher} -n ${npe_atmanalrun}"

elif [[ "${step}" = "atmensanalrun" ]]; then
elif [[ "${step}" = "atmensanlrun" ]]; then

export CFP_MP=${CFP_MP:-"YES"}
export USE_CFP=${USE_CFP:-"YES"}
export APRUNCFP="${launcher} -n \$ncmd ${mpmd_opt}"

nth_max=$((npe_node_max / npe_node_atmensanalrun))
nth_max=$((npe_node_max / npe_node_atmensanlrun))

export NTHREADS_ATMENSANAL=${nth_atmensanalrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANAL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANAL=${nth_max}
export APRUN_ATMENSANAL="${launcher} -n ${npe_atmensanalrun}"
export NTHREADS_ATMENSANL=${nth_atmensanlrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANL=${nth_max}
export APRUN_ATMENSANL="${launcher} -n ${npe_atmensanlrun}"

elif [[ "${step}" = "aeroanlrun" ]]; then

Expand Down
12 changes: 6 additions & 6 deletions env/S4.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "aeroanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen efcs epos"
Expand Down Expand Up @@ -59,17 +59,17 @@ elif [[ "${step}" = "atmanalrun" ]]; then
[[ ${NTHREADS_ATMANAL} -gt ${nth_max} ]] && export NTHREADS_ATMANAL=${nth_max}
export APRUN_ATMANAL="${launcher} -n ${npe_atmanalrun}"

elif [[ "${step}" = "atmensanalrun" ]]; then
elif [[ "${step}" = "atmensanlrun" ]]; then

export CFP_MP=${CFP_MP:-"YES"}
export USE_CFP=${USE_CFP:-"YES"}
export APRUNCFP="${launcher} -n \$ncmd ${mpmd_opt}"

nth_max=$((npe_node_max / npe_node_atmensanalrun))
nth_max=$((npe_node_max / npe_node_atmensanlrun))

export NTHREADS_ATMENSANAL=${nth_atmensanalrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANAL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANAL=${nth_max}
export APRUN_ATMENSANAL="${launcher} -n ${npe_atmensanalrun}"
export NTHREADS_ATMENSANL=${nth_atmensanlrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANL=${nth_max}
export APRUN_ATMENSANL="${launcher} -n ${npe_atmensanlrun}"

elif [[ "${step}" = "aeroanlrun" ]]; then

Expand Down
12 changes: 6 additions & 6 deletions env/WCOSS2.env
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ if [[ $# -ne 1 ]]; then

echo "Must specify an input argument to set runtime environment variables!"
echo "argument can be any one of the following:"
echo "atmanalrun atmensanalrun"
echo "atmanalrun atmensanlrun"
echo "aeroanlrun"
echo "anal sfcanl fcst post vrfy metp"
echo "eobs eupd ecen esfc efcs epos"
Expand Down Expand Up @@ -48,17 +48,17 @@ elif [[ "${step}" = "atmanalrun" ]]; then
[[ ${NTHREADS_ATMANAL} -gt ${nth_max} ]] && export NTHREADS_ATMANAL=${nth_max}
export APRUN_ATMANAL="${launcher} -n ${npe_atmanalrun}"

elif [[ "${step}" = "atmensanalrun" ]]; then
elif [[ "${step}" = "atmensanlrun" ]]; then

export CFP_MP=${CFP_MP:-"YES"}
export USE_CFP=${USE_CFP:-"YES"}
export APRUNCFP="${launcher} -np \$ncmd ${mpmd_opt}"

nth_max=$((npe_node_max / npe_node_atmensanalrun))
nth_max=$((npe_node_max / npe_node_atmensanlrun))

export NTHREADS_ATMENSANAL=${nth_atmensanalrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANAL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANAL=${nth_max}
export APRUN_ATMENSANAL="${launcher} -n ${npe_atmensanalrun}"
export NTHREADS_ATMENSANL=${nth_atmensanlrun:-${nth_max}}
[[ ${NTHREADS_ATMENSANL} -gt ${nth_max} ]] && export NTHREADS_ATMENSANL=${nth_max}
export APRUN_ATMENSANL="${launcher} -n ${npe_atmensanlrun}"

elif [[ "${step}" = "aeroanlrun" ]]; then

Expand Down
66 changes: 0 additions & 66 deletions jobs/JGDAS_GLOBAL_ATMOS_ENSANAL_POST

This file was deleted.

66 changes: 0 additions & 66 deletions jobs/JGDAS_GLOBAL_ATMOS_ENSANAL_PREP

This file was deleted.

Original file line number Diff line number Diff line change
@@ -1,21 +1,23 @@
#!/bin/bash
#! /usr/bin/env bash

source "${HOMEgfs}/ush/preamble.sh"
source "${HOMEgfs}/ush/jjob_header.sh" -e "atmensanalrun" -c "base atmensanal atmensanalrun"

export WIPE_DATA="NO"
export DATA=${DATA:-${DATAROOT}/${RUN}atmensanl_${cyc}}
source "${HOMEgfs}/ush/jjob_header.sh" -e "atmensanlfinal" -c "base atmensanl atmensanlfinal"

##############################################
# Set variables used in the script
##############################################
export CDATE=${CDATE:-${PDY}${cyc}}
export CDUMP=${CDUMP:-${RUN:-"gfs"}}
export COMPONENT="atmos"


##############################################
# Begin JOB SPECIFIC work
##############################################

export GDATE=$(date +%Y%m%d%H -d "${CDATE:0:8} ${CDATE:8:2} - ${assim_freq} hours")
GDATE=$(date +%Y%m%d%H -d "${CDATE:0:8} ${CDATE:8:2} - ${assim_freq} hours")
export GDATE
gPDY=${GDATE:0:8}
export gcyc=${GDATE:8:2}
export GDUMP=${GDUMP:-"gdas"}
Expand All @@ -24,27 +26,21 @@ export OPREFIX="${CDUMP}.t${cyc}z."
export GPREFIX="${GDUMP}.t${gcyc}z."
export APREFIX="${CDUMP}.t${cyc}z."

export COMOUT=${COMOUT:-${ROTDIR}/${CDUMP}.${PDY}/${cyc}/${COMPONENT}}
export COMOUT_ENS=${COMOUT_ENS:-${ROTDIR}/enkf${CDUMP}.${PDY}/${cyc}/${COMPONENT}}
export COMOUT=${COMOUT:-${ROTDIR}/${CDUMP}.${PDY}/${cyc}}

mkdir -p ${COMOUT}
mkdir -p ${COMOUT_ENS}
mkdir -p "${COMOUT}"

# COMIN_GES and COMIN_GES_ENS are used in script
export COMIN="${ROTDIR}/${CDUMP}.${PDY}/${cyc}/${COMPONENT}"
export COMIN_GES="${ROTDIR}/${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}"
export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${gPDY}/${gcyc}/${COMPONENT}"

# Add UFSDA to PYTHONPATH
export PYTHONPATH=${HOMEgfs}/sorc/gdas.cd/ush/:${PYTHONPATH}
export COMIN_GES="${ROTDIR}/${GDUMP}.${gPDY}/${gcyc}/atmos"
export COMIN_GES_ENS="${ROTDIR}/enkf${GDUMP}.${gPDY}/${gcyc}"

###############################################################
# Run relevant script

EXSCRIPT=${GDASRUNSH:-${HOMEgfs}/scripts/exgdas_global_atmos_ensanal_run.sh}
EXSCRIPT=${GDASATMENSFINALPY:-${HOMEgfs}/scripts/exglobal_atmens_analysis_finalize.py}
${EXSCRIPT}
status=$?
[[ ${status} -ne 0 ]] && exit ${status}
[[ ${status} -ne 0 ]] && exit "${status}"

##############################################
# End JOB SPECIFIC work
Expand All @@ -53,14 +49,14 @@ status=$?
##############################################
# Final processing
##############################################
if [ -e "${pgmout}" ] ; then
cat ${pgmout}
if [[ -e "${pgmout}" ]] ; then
cat "${pgmout}"
fi

##########################################
# Remove the Temporary working directory
##########################################
cd ${DATAROOT}
[[ ${KEEPDATA} = "NO" ]] && rm -rf ${DATA}
cd "${DATAROOT}" || exit 1
[[ ${KEEPDATA} = "NO" ]] && rm -rf "${DATA}"

exit 0
Loading