Skip to content

Conversation

@Sylviabohnenstengel
Copy link
Contributor

@Sylviabohnenstengel Sylviabohnenstengel commented Nov 25, 2025

fixes #1823

Contribution checklist

Aim to have all relevant checks ticked off before merging. See the developer's guide for more detail.

  • Documentation has been updated to reflect change.
  • New code has tests, and affected old tests have been updated.
  • All tests and CI checks pass.
  • Ensured the pull request title is descriptive.
  • Conda lock files have been updated if dependencies have changed.
  • Attributed any Generative AI, such as GitHub Copilot, used in this PR.
  • Marked the PR as ready to review.

…tions and reflecting seamless approach for time and space scales i.e. weather and (regional) climate in documentation
@Sylviabohnenstengel Sylviabohnenstengel self-assigned this Nov 25, 2025
@Sylviabohnenstengel Sylviabohnenstengel added this to the CSET v25.11.0 milestone Nov 25, 2025
@Sylviabohnenstengel Sylviabohnenstengel added the documentation Improvements or additions to documentation label Nov 25, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Nov 25, 2025

Coverage

@Sylviabohnenstengel Sylviabohnenstengel marked this pull request as ready for review November 25, 2025 17:55
Copy link
Contributor

@ukmo-huw-lewis ukmo-huw-lewis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In general, think these are looking like good changes.

Review has got me thinking further on some aspects, maybe in particular greater use of bullets to aid readability, and some suggested/requested changes to phrasing and emphasis that I hope worth considering before we make these changes.

Note also comment on value of consistency with top-level GitHub pages.

Finally, given the shift to Community Seamless Evaluation Toolkit, I have had in view the value of setting out what these words mean - I think each is powerful and usefully explain some of the 'philosophy' and what to expect from CSET. Can we add this narrative somewhere? A starter for 10 offered below (have a go at making these shorter/impactful etc):

Community: Software developed for and by a wide network of model development and evaluation scientists, enabling common approaches to distributed evaluation activities.
Seamless: Supporting assessment, evaluation, verification and understanding of physical and machine learning models across time and space scales, and from regional to global application.
Evaluation: Providing a process-oriented focus to model assessment, supporting depth of comparison between different model configurations and assessment relative to a range of observations.
Toolkit: A flexible software including code, recipes and workflow to manage a range of user requirements, underpinned by modern software development practices.


CSET provides a centralised and peer-reviewed source of tools to aid
process-oriented evaluation for UM and LFRic models, supporting both
process-oriented evaluation for UM, LFRic physical and ML models, supporting both
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggest to make this more model agnostic here:

....to aid process-oriented evaluation for physical and machine learning models, supporting both...

CSET is expanding it's support for verification and evaluation of machine learned models
and utilises observations from a range of sources to aid in the evaluation process.
It will utilise the Model Evaluation Tools (MET) software to provide a range of
verification metrics aligned with operational verification best practices.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Propose....

CSET is designed to be continuously evolving and improving, driven by community inputs. Support for verification and evaluation of a range of machine learning models is expected to grow, alongside use of observations from an increasing range of sources to support evaluation. It will utilise the Model Evaluation Tools (MET) software to provide a range of verification metrics aligned with operational verification best practices. Where relevant, CSET will provide interfaces to utilise other evaluation packages to support particular evaluation requirements.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

included

Copy link
Contributor Author

@Sylviabohnenstengel Sylviabohnenstengel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

worked though your suggestions and included them into the documents. Still working on some changes

CSET is expanding it's support for verification and evaluation of machine learned models
and utilises observations from a range of sources to aid in the evaluation process.
It will utilise the Model Evaluation Tools (MET) software to provide a range of
verification metrics aligned with operational verification best practices.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

included

@Sylviabohnenstengel
Copy link
Contributor Author

Still working on some changes so please don't merge.

@Sylviabohnenstengel
Copy link
Contributor Author

GitHub copilot used to help with formatting

@Sylviabohnenstengel
Copy link
Contributor Author

@Fraetor wondering if the Why CSET? section under background is becoming obsolete.

@jfrost-mo
Copy link
Member

The "Why CSET" page is intended to provide detailed justification for CSET without overwhelming people on the documentation landing page. So I'm not sure its becoming obsolete, but it may need updating to reflect CSET's current position.

@jfrost-mo jfrost-mo marked this pull request as draft November 27, 2025 09:53
@jfrost-mo jfrost-mo changed the title updating documentation: larger remit of CSET to ML models and observa… Update documentation to reflect larger remit of CSET Nov 27, 2025
Copy link
Contributor Author

@Sylviabohnenstengel Sylviabohnenstengel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

happy with changes

@Sylviabohnenstengel Sylviabohnenstengel marked this pull request as ready for review November 27, 2025 11:56
Copy link
Member

@jfrost-mo jfrost-mo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the documentation landing page (index.rst) is probably getting a little bit overwhelmed with detail. My suggestion would be to cut it down, so it has the same content as the README, and move the additional detail to the why-cset page. Then have a link from the index to the why-cset page.

This way, people who are already convinced are not overwhelmed with excessive detail or background, while those that desire it can find out more about the rational.

CSET is a toolkit for evaluation, verification and investigation of convective-
and turbulence-scale numerical models for weather and climate applications,
cutting across time and space scales.
CSET, the Community Seamless Evaluation Toolkit, is an open-source toolkit for evaluating weather and climate models, including physical numerical and machine learning models, as well as observations. It focuses on high-resolution atmospheric processes, from convective to turbulence scales, across regional to global domains.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
CSET, the Community Seamless Evaluation Toolkit, is an open-source toolkit for evaluating weather and climate models, including physical numerical and machine learning models, as well as observations. It focuses on high-resolution atmospheric processes, from convective to turbulence scales, across regional to global domains.
CSET, the Community Seamless Evaluation Toolkit, is an open source toolkit for evaluating weather and climate models, including physical numerical, machine learning models, and observations. It focuses on high-resolution atmospheric processes, from convective to turbulence scales, across regional or global domains.

Comment on lines +17 to +20
CSET is built with portability in mind and can be run on:
- Local desktops.
- HPC systems.
- Cloud servers.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
CSET is built with portability in mind and can be run on:
- Local desktops.
- HPC systems.
- Cloud servers.
CSET is built with portability in mind and can be [easily installed](https://metoffice.github.io/CSET/getting-started/installation.html).

Rather than enumerating the kinds of systems CSET can be installed on, we should just emphasise that it is easy to install.

- A legacy for model and observation based diagnostics through continued maintenance and improved discoverability.

CSET is built using a modern software stack, underpinned by
- python3,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- python3,
- python 3,

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure we need to specify that we use python 3. The GitHub UI already shows that CSET is mostly python, and python 2 is very much dead by now.


CSET is built using a modern software stack, underpinned by
- python3,
- iris and
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
- iris and
- iris

@jfrost-mo
Copy link
Member

I've made some changes in #1831. If you are happy with them you should be able to merge that PR into this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update documentation to reflect larger CSET remit

4 participants