more tutorial refactoring

[keewis]

follow-up to #4102. This reverts the combination of tutorial.open_dataset and tutorial.open_rasterio (the concept of tutorial.open_* is "cached download+open_*"), and updates the tests to not depend on a environment variable (which makes the tests also run on macos and windows).

In #4102 I added a list of available datasets, but it would be good to add a small description. I still need descriptions for:

• air_temperature
• rasm
• ROMS_example
• era5-2mt-2019-03-uk.grib
• RGB.byte (the readme says "derived from USGS Landsat 7 ETM imagery")

---

• Passes pre-commit run --all-files
• User visible changes (including notable bug fixes) are documented in whats-new.rst

[keewis]

I decided to also make "shade.tif" from rasterio's test data available through tutorial.open_rasterio (doesn't have to be this file, though, I just wanted to make sure tutorial.open_rasterio can open more than one file).

This should be ready to merge as is (once the tests pass) but the dataset descriptions still need to be done.

[keewis]

I dug through the history of xarray-data and tried to add a description for all datasets but I'm not sure I got everything right. If I did this should be ready for a final review and then merging.

[keewis]

ping. Should we try to silence the

Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future.

warning? Otherwise this should be ready for merging (but please do check the dataset descriptions, I'm really not sure about those).

[shoyer]

Yes, we should silence this! And maybe make a feature request to Pooch

…

On Sat, Apr 17, 2021 at 3:15 PM keewis ***@***.***> wrote: ping. Should we try to silence the Use this value as the 'known_hash' argument of 'pooch.retrieve' to ensure that the file hasn't changed if it is downloaded again in the future. warning? Otherwise this should be ready for merging (but please do check the dataset descriptions, I'm really not sure about those). — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#5074 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAJJFVST2EEKN3D4WK5EZQLTJIB77ANCNFSM4ZYJDKPQ> .

[keewis]

how, exactly? I can probably add a warnings filter, but we could also add tags to xarray-data and hard-code that together with the hash sums in xarray.tutorial (I think we talked about that in #4102). Thoughts, @andersy005?

[shoyer]

how, exactly? I can probably add a warnings filter, but we could also add tags to xarray-data and hard-code that together with the hash sums in xarray.tutorial (I think we talked about that in #4102). Thoughts, @andersy005?

see here for an example: https://docs.python.org/3/library/warnings.html#temporarily-suppressing-warnings

[keewis]

oh, sorry. I actually meant to ask whether I should use the way recommend by pooch or simply suppress the warning. I guess that still answers that question, though.

Edit: actually, that's not a warning: it seems that's a logging.info message, so I would have to filter the logs (or adjust the default log level). Not sure if that's easy to do?

[max-sixty]

We could do something like, which is a bit overbearing, but would solve this until it's unblocked by pooch:

logging.getLogger("google.cloud.bigquery.opentelemetry_tracing").setLevel(
    logging.CRITICAL
)

(there may well be ways of doing this only within our execution, which we could do if this is a long-term solution)

[shoyer]

Pooch really shouldn't be registering it's own logger, since it's a library not an application: fatiando/pooch#232

That said, for now I agree with @max-sixty's recommendation. It's recommended in the Pooch docs, too:
https://www.fatiando.org/pooch/dev/advanced.html#adjusting-the-logging-level

[keewis]

I didn't see that part of the documentation, this should be fixed now. Thanks for the hints, @max-sixty, @shoyer.

[keewis]

we have to make sure to deprecate / remove xr.tutorial.open_rasterio along with xr.open_rasterio, but otherwise this is ready.