Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add fire blending to GOCART #2883

Open
wants to merge 54 commits into
base: develop
Choose a base branch
from
Open

Add fire blending to GOCART #2883

wants to merge 54 commits into from

Conversation

bbakernoaa
Copy link
Contributor

Description

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? YES/NO
  • Does this change require a documentation update? YES/NO
  • Does this change require an update to any of the following submodules? YES/NO (If YES, please add a link to any PRs that are pending.)
    • EMC verif-global
    • GDAS
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • I have made corresponding changes to the documentation if necessary

@bbakernoaa bbakernoaa marked this pull request as ready for review September 13, 2024 13:05
@bbakernoaa bbakernoaa marked this pull request as draft September 13, 2024 14:03
@WalterKolczynski-NOAA WalterKolczynski-NOAA changed the title [GOCART] Add Fire Blending Add fire blending to GOCART Sep 17, 2024
@aerorahul aerorahul added CI-Gaea-Ready **CM use only** PR is ready for CI testing on Gaea and removed CI-Gaea-Ready **CM use only** PR is ready for CI testing on Gaea labels Sep 19, 2024
@AntonMFernando-NOAA @bbakernoaa
Cleanup job for GEFS (NOAA-EMC#2919)
b22d7bc 
As forecast ensemble jobs are added to the global workflow, this PR
ensures the output is being cleaned up properly once it is no longer
needed.
  Resolves NOAA-EMC#833
@BoCui-NOAA @bbakernoaa
Update config.resources for bufr sounding job postsnd (NOAA-EMC#2917)
9965857 
This PR updates the parm/config/gfs/config.resources and env/WCOSS2.env
files for the BUFR sounding job "postsnd." It includes adjustments to
resource settings such as tasks per node and memory allocations for
various GFS resolutions, including C768, C1152, and others.

Here are the proposed changes:

C768: 7 nodes, 21 tasks per node
C1152: 16 nodes, 9 tasks per node
@mingshichen-noaa @bbakernoaa
Update global atmos upp job to use COMIN/COMOUT (NOAA-EMC#2867)
5b57604 
NCO has requested that each COM variable specify whether it is an input
or an output. This completes that process for the global-workflow
Unified Post Processor (UPP) task.
Refs: NOAA-EMC#2451
@KateFriedman-NOAA @bbakernoaa
Update to obsproc/v1.2.0 and prepobs/v1.1.0 (NOAA-EMC#2903)
1f95b2b 
This PR updates the `develop` branch to use the newer operational
`obsproc/v1.2.0` and `prepobs/v1.1.0`. The obsproc/prepobs installs in
glopara space on supported platforms use tags cut from the `dev/gfsv17`
branches in the respective repos. The installation of `prepobs/v1.1.0`
on WCOSS2 is called "gfsv17_v1.1.0" to help avoid GFSv16 users using it
instead of the operational module.

Also, the `HOMEobsproc` path is updated to set an empty default for
`obsproc_run_ver`. This both removes the need to set a default (and
constantly update it, which is duplication) and avoid the unset variable
error when the fcst jobs use their own load module script that does not
know `obsproc_run_ver`:
```
export HOMEobsproc="${BASE_GIT:-}/obsproc/v${obsproc_run_ver:-}"
```

This PR also reverts the prepobs and fit2obs installs on MSU back to the
glopara space from the temporary `/work/noaa/global/kfriedma/glopara`
space installs.

Lastly, this PR also includes updates to complete issue NOAA-EMC#2844 (merge
`build.spack.ver` and `run.spack.ver`).

Resolves NOAA-EMC#2291
Resolves NOAA-EMC#2840
Resolves NOAA-EMC#2844
@bbakernoaa
Merge remote-tracking branch 'remotes/upstream/develop' into feature/…
eb8bc78 
…fire_blending
@aerorahul
Merge branch 'develop' into feature/fire_blending
9a9a874
aerorahul
aerorahul requested changes Sep 25, 2024
View reviewed changes
Copy link
Contributor

@aerorahul aerorahul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bbakernoaa
Please let me know if any of my comments need clarifications

parm/config/gefs/config.prep_emissions Show resolved Hide resolved
parm/prep/aero_emissions.yaml Outdated Show resolved Hide resolved
parm/prep/aero_emissions.yaml Outdated Show resolved Hide resolved
parm/prep/aero_emissions.yaml Outdated Show resolved Hide resolved
parm/prep/aero_emissions.yaml Outdated Show resolved Hide resolved
ush/python/pygfs/task/aero_emissions.py Outdated Show resolved Hide resolved
ush/python/pygfs/task/aero_emissions.py Outdated Show resolved Hide resolved
ush/python/pygfs/task/aero_emissions.py Outdated Show resolved Hide resolved
ush/python/pygfs/task/aero_emissions.py Outdated Show resolved Hide resolved
ush/python/pygfs/task/aero_emissions.py Show resolved Hide resolved
bbakernoaa and others added 6 commits October 7, 2024 09:40
@bbakernoaa @aerorahul
Update parm/prep/aero_emissions.yaml
3b87649 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update parm/prep/aero_emissions.yaml
21d7bad 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update parm/prep/aero_emissions.yaml
58e7280 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update parm/prep/aero_emissions.yaml
f74f471 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update ush/python/pygfs/task/aero_emissions.py
945508f 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa
add coarsen_scale to yaml and use in aero_emission.py
eb53925
bbakernoaa and others added 4 commits October 17, 2024 11:14
@bbakernoaa @aerorahul
Update ush/python/pygfs/task/aero_emissions.py
9583817 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update ush/python/pygfs/task/aero_emissions.py
ec4f462 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa @aerorahul
Update ush/python/pygfs/task/aero_emissions.py
65572fa 
Co-authored-by: Rahul Mahajan <aerorahul@users.noreply.github.com>
@bbakernoaa
add changes to copy the data for each fire case and add a method that…
ffb8664 
… if hfed is used just to transform the data... ie don't really process
@bbakernoaa bbakernoaa marked this pull request as ready for review October 17, 2024 20:39
@bbakernoaa @DavidHuber-NOAA
Update scripts/exglobal_prep_emissions.py
f204898 
Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
DavidHuber-NOAA
DavidHuber-NOAA reviewed Oct 18, 2024
View reviewed changes
ush/python/pygfs/task/aero_emissions.py
"""
logger.info("Copy Static Data to run directory")

print(aero_emission_yaml)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggest either deleting or changing to a debug logger.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should just remove it.

DavidHuber-NOAA
DavidHuber-NOAA reviewed Oct 18, 2024
View reviewed changes
ush/python/pygfs/task/aero_emissions.py
clim_slice = clim.data[index, :, :]

# Calculate the weighted alpha ratio parameter
# alpha = 1.0 - 1.0 / (index + 1)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this an option for a later time, an experimental option, or an interpretation of line 378? If the former, should it have a TODO?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can remove it from here. This script was originally developed outside of the workflow and has some legacy items there

@aerorahul
Copy link
Contributor

@bbakernoaa
Others, please don't hold this PR for my review. I think I have reviewed this PR and will let others review and provide comments.

bbakernoaa and others added 2 commits October 18, 2024 13:09
@bbakernoaa @DavidHuber-NOAA
Update ush/python/pygfs/task/aero_emissions.py
e7bf48a 
Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
@bbakernoaa @DavidHuber-NOAA
Update ush/python/pygfs/task/aero_emissions.py
eab4554 
Co-authored-by: David Huber <69919478+DavidHuber-NOAA@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@CoryMartin-NOAA CoryMartin-NOAA CoryMartin-NOAA left review comments

@WalterKolczynski-NOAA WalterKolczynski-NOAA WalterKolczynski-NOAA left review comments

@DavidHuber-NOAA DavidHuber-NOAA DavidHuber-NOAA left review comments

@AntonMFernando-NOAA AntonMFernando-NOAA Awaiting requested review from AntonMFernando-NOAA

@GwenChen-NOAA GwenChen-NOAA Awaiting requested review from GwenChen-NOAA GwenChen-NOAA is a code owner

@DavidNew-NOAA DavidNew-NOAA Awaiting requested review from DavidNew-NOAA DavidNew-NOAA is a code owner

@RussTreadon-NOAA RussTreadon-NOAA Awaiting requested review from RussTreadon-NOAA RussTreadon-NOAA is a code owner

@KateFriedman-NOAA KateFriedman-NOAA Awaiting requested review from KateFriedman-NOAA KateFriedman-NOAA is a code owner

@TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA Awaiting requested review from TerrenceMcGuinness-NOAA TerrenceMcGuinness-NOAA is a code owner

@aerorahul aerorahul Awaiting requested review from aerorahul aerorahul is a code owner

Requested changes must be addressed to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
9 participants
@bbakernoaa @aerorahul @CoryMartin-NOAA @WalterKolczynski-NOAA @DavidHuber-NOAA @AntonMFernando-NOAA @BoCui-NOAA @mingshichen-noaa @KateFriedman-NOAA