Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cache rasterio example files #4102

Merged
merged 58 commits into from
Mar 24, 2021
Merged

cache rasterio example files #4102

merged 58 commits into from
Mar 24, 2021

Commits on May 27, 2020

  1. add a open_rasterio function to tutorial

    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    a8b0022 View commit details
    Browse the repository at this point in the history

  2. put the cache directory into .cache if that exists

    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    3997c27 View commit details
    Browse the repository at this point in the history

  3. raise an error if the status code is not 200 

    the exception class might not be the best choice, though.
    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    b45e28d View commit details
    Browse the repository at this point in the history

  4. use the cached file if possible

    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    e972d84 View commit details
    Browse the repository at this point in the history

  5. add a test to check that the caching does not affect the result

    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    7b5e6d5 View commit details
    Browse the repository at this point in the history

  6. use the new tutorial function in the visualization gallery

    @keewis
    keewis committed May 27, 2020
    Configuration menu
    Copy the full SHA
    e435103 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2020

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Jun 24, 2020
    Configuration menu
    Copy the full SHA
    75dac85 View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2020

  1. fix the temporary directory creation

    @keewis
    keewis committed Jun 27, 2020
    Configuration menu
    Copy the full SHA
    8fe0c92 View commit details
    Browse the repository at this point in the history

  2. rewrite open_dataset to use the same functions as open_rasterio

    @keewis
    keewis committed Jun 27, 2020
    Configuration menu
    Copy the full SHA
    783baeb View commit details
    Browse the repository at this point in the history

  3. make sure the context manager on a pathlib object always works

    @keewis
    keewis committed Jun 27, 2020
    Configuration menu
    Copy the full SHA
    d6623ff View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2020

  1. require requests

    @keewis
    keewis committed Jun 28, 2020
    Configuration menu
    Copy the full SHA
    f834883 View commit details
    Browse the repository at this point in the history

  2. add requests to most CI 

    though the tests are only run on py38
    @keewis
    keewis committed Jun 28, 2020
    Configuration menu
    Copy the full SHA
    5ddadab View commit details
    Browse the repository at this point in the history

Commits on Jun 29, 2020

  1. split into two context managers

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    21f090d View commit details
    Browse the repository at this point in the history

  2. use is_dir instead of exists to check for .cache

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    068b660 View commit details
    Browse the repository at this point in the history

  3. reword a few comments

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    c5d1490 View commit details
    Browse the repository at this point in the history

  4. properly credit the SO answer

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    b457c19 View commit details
    Browse the repository at this point in the history

  5. add a pseudo-atomic open function

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    c9faac1 View commit details
    Browse the repository at this point in the history

  6. add a random part to the file so concurrent calls are not an issue

    @keewis
    keewis committed Jun 29, 2020
    Configuration menu
    Copy the full SHA
    f16a15f View commit details
    Browse the repository at this point in the history

Commits on Jun 30, 2020

  1. vendor appdirs.user_cache_dir and use it to determine the default cache

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    f9abf31 View commit details
    Browse the repository at this point in the history

  2. properly vendor appdirs

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    c276876 View commit details
    Browse the repository at this point in the history

  3. suppress FileNotFoundErrors while removing a file

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    fdb9b11 View commit details
    Browse the repository at this point in the history

  4. silence mypy

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    427b4cf View commit details
    Browse the repository at this point in the history

  5. make sure to convert string paths to pathlib.Path

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    bd2cafc View commit details
    Browse the repository at this point in the history

  6. convert the result of appdirs.user_cache_dir to pathlib.Path

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    9d4bce3 View commit details
    Browse the repository at this point in the history

  7. add the comment about switching to unlink(missing_ok=True)

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    4297920 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Jun 30, 2020
    Configuration menu
    Copy the full SHA
    9fde5d6 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2020

  1. use requests.codes.ok instead of the numeric value

    @keewis
    keewis committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    adfce27 View commit details
    Browse the repository at this point in the history

  2. remove the md5 checking code

    @keewis
    keewis committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    ea9d4dc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    d828720 View commit details
    Browse the repository at this point in the history

  4. try to make the comment clearer

    @keewis
    keewis committed Jul 16, 2020
    Configuration menu
    Copy the full SHA
    745de23 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2020

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Jul 26, 2020
    Configuration menu
    Copy the full SHA
    c1229ae View commit details
    Browse the repository at this point in the history

  2. typo

    @keewis
    keewis committed Jul 26, 2020
    Configuration menu
    Copy the full SHA
    29b78ed View commit details
    Browse the repository at this point in the history

  3. isort

    @keewis
    keewis committed Jul 26, 2020
    Configuration menu
    Copy the full SHA
    8d04bba View commit details
    Browse the repository at this point in the history

Commits on Nov 6, 2020

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Nov 6, 2020
    Configuration menu
    Copy the full SHA
    dd08972 View commit details
    Browse the repository at this point in the history

Commits on Dec 9, 2020

  1. remove all code related to the detection of the application directory

    @keewis
    keewis committed Dec 9, 2020
    Configuration menu
    Copy the full SHA
    77e2487 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Dec 9, 2020
    Configuration menu
    Copy the full SHA
    e8b4a00 View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2021

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Jan 12, 2021
    Configuration menu
    Copy the full SHA
    f730a85 View commit details
    Browse the repository at this point in the history

Commits on Jan 15, 2021

  1. use pooch for caching and fetching the files

    @keewis
    keewis committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    39e7d77 View commit details
    Browse the repository at this point in the history

  2. remove requests from the CI environments

    @keewis
    keewis committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    9134d7a View commit details
    Browse the repository at this point in the history

  3. add pooch to the environment used by the py38-flaky CI

    @keewis
    keewis committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    fa89822 View commit details
    Browse the repository at this point in the history

  4. remove the install_requires on requests and the vendor mypy ignore [s… 

    …kip-ci]
    @keewis
    keewis committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    56d7e49 View commit details
    Browse the repository at this point in the history

  5. add pooch to the doc environment [skip-ci]

    @keewis
    keewis committed Jan 15, 2021
    Configuration menu
    Copy the full SHA
    b848c66 View commit details
    Browse the repository at this point in the history

Commits on Mar 20, 2021

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Mar 20, 2021
    Configuration menu
    Copy the full SHA
    dab96de View commit details
    Browse the repository at this point in the history

  2. ignore missing type hints for pooch

    @keewis
    keewis committed Mar 20, 2021
    Configuration menu
    Copy the full SHA
    405a90e View commit details
    Browse the repository at this point in the history

Commits on Mar 22, 2021

  1. Merge branch 'master' into refactor-tutorial

    @keewis
    keewis committed Mar 22, 2021
    Configuration menu
    Copy the full SHA
    cc6cade View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2021

  1. add a mapping of external urls

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    817a6ba View commit details
    Browse the repository at this point in the history

  2. remove tutorial.open_rasterio

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    0b60eb0 View commit details
    Browse the repository at this point in the history

  3. remove the github_url and branch PRs

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    d82b816 View commit details
    Browse the repository at this point in the history

  4. allow opening rasterio files using open_dataset

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    719765c View commit details
    Browse the repository at this point in the history

  5. remove the reference to xarray.tutorial.open_dataset

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    0a489c4 View commit details
    Browse the repository at this point in the history

  6. rename engine_overrides to overrides

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    0335473 View commit details
    Browse the repository at this point in the history

  7. update the docstring

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    cc3eb3c View commit details
    Browse the repository at this point in the history

  8. update the rasterio test

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    04e15fb View commit details
    Browse the repository at this point in the history

  9. use explicitly passed values for engine

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    6f02db4 View commit details
    Browse the repository at this point in the history

  10. use open_dataset instead of open_rasterio

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    653e5fd View commit details
    Browse the repository at this point in the history

  11. convert back to a data array [skip-ci]

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    b250b38 View commit details
    Browse the repository at this point in the history

  12. write the files to a temporary cache directory 

    this avoids having to modify the global cache dir *and* we don't need
_default_cache_dir. This only works on linux, though, for windows and macOS we would
need something else.
    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    78c11f5 View commit details
    Browse the repository at this point in the history

  13. typo

    @keewis
    keewis committed Mar 23, 2021
    Configuration menu
    Copy the full SHA
    b532879 View commit details
    Browse the repository at this point in the history