Skip to content

Conversation

@b8raoult
Copy link
Collaborator

@b8raoult b8raoult commented Oct 6, 2025

Description

This is a PR to prepare for the observations support. This PR merely move files around, so a lot of files are affected, but there should not be any code change. This prepares for further PRs that may affect the code more. This should be kinder on reviewers.

Naming conventions proposed here:
Move from "create" -> "build"

Introduce two types of datasets to be built:
gridded & tabular

What problem does this change solve?

What issue or task does this change relate to?

Additional notes

As a contributor to the Anemoi framework, please ensure that your changes include unit tests, updates to any affected dependencies and documentation, and have been tested in a parallel setting (i.e., with multiple GPUs). As a reviewer, you are also responsible for verifying these aspects and requesting changes if they are not adequately addressed. For guidelines about those please refer to https://anemoi.readthedocs.io/en/latest/

By opening this pull request, I affirm that all authors agree to the Contributor License Agreement.

@HCookie HCookie moved this from Under Review to Reviewers needed in Anemoi-dev Nov 17, 2025
"grid_definition": {
"icon": {
"path": gridfile,
"refinement_level_c": input_refinement_level_c,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this inconsistency. I think in general there is no need to set refinement_level_c for the icon grid_definition as the grid must always correspond to the grib data. Thus I would make the following suggestion:

Suggested change
"refinement_level_c": input_refinement_level_c,
"refinement_level_c": None,

If I understood the earthkit team correctly, they are working on supporting ICON grids. I.e. it will be possible to ask EKD for the grid definition, making the icon grid_definition in anemoi-datatests unnecessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ATS Approval not needed CI/CD dependencies Pull requests that update a dependency file tests

Projects

Status: Reviewers needed

Development

Successfully merging this pull request may close these issues.

9 participants