Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[python] actions{cache,checkout,setup-python} upgrades #2856

Merged
merged 6 commits into from
Aug 8, 2024
Merged

Conversation

ryan-williams
Copy link
Member

@ryan-williams ryan-williams commented Aug 8, 2024

Issue and/or context: some of this came from debugging actions/setup-python#919 on #2853. In particular, I wanted to test on latest setup-python (v5) there, though it turns out that issue seems to occur on both v4 and v5.

Changes:

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.
rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)
Copy link

codecov bot commented Aug 8, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.19%. Comparing base (3fae283) to head (b9e97bf).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2856      +/-   ##
==========================================
+ Coverage   90.04%   90.19%   +0.15%     
==========================================
  Files          37       37              
  Lines        3957     3957              
==========================================
+ Hits         3563     3569       +6     
+ Misses        394      388       -6     
Flag Coverage Δ
python 90.19% <ø> (+0.15%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Components Coverage Δ
python_api 90.19% <ø> (+0.15%) ⬆️
libtiledbsoma ∅ <ø> (∅)

@ryan-williams ryan-williams marked this pull request as ready for review August 8, 2024 18:50
@ryan-williams
Copy link
Member Author

r-ci.yml failure is the usual segfault. I broke it in a new way in #2854, without noticing, but have fixed that here. Everything else ✅, merging.

@ryan-williams ryan-williams merged commit 7742bff into main Aug 8, 2024
24 of 25 checks passed
@ryan-williams ryan-williams deleted the rw/ci branch August 8, 2024 20:34
mojaveazure added a commit that referenced this pull request Aug 9, 2024
* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
eddelbuettel pushed a commit that referenced this pull request Aug 9, 2024
* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
eddelbuettel pushed a commit that referenced this pull request Aug 19, 2024
* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
eddelbuettel pushed a commit that referenced this pull request Aug 22, 2024
* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
mojaveazure added a commit that referenced this pull request Aug 26, 2024
* Timestamp range support for dataframe

* Extended support

* (First half) new timestamp test for SOMADataFrame

* Second half of new timestamp passing all but three reopen tests

* [r] Expose `tiledb_timestamp` parameter to `$reopen()` (#2866)

* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>

* [r] [NO BACKPORT] Expose timestamps publicly and plumb through for resume-mode (#2871)

Expose timestamps publicly through a new active binding; replace calls to `private$tiledb_timestamp` with `self$tiledb_timestamp`

Also plumb timestamps through for `write_soma()` in resume-mode

* Timestamp range support for dataframe

* (First half) new timestamp test for SOMADataFrame

* Second half of new timestamp passing all but three reopen tests

* Test can now use factor

* Read and write DataFrame and {Dense,Sparse}Array under timestamps

* Quieter warnings

* Adapt one timestamped test

* Pause one test predicate for collections

* clang-format

as obsessing over one whitespace char before a comment is added value

* Micro-fix following code review

More changes to follow in wider changeset

* Update changelog
Bump develop version

---------

Co-authored-by: Paul Hoffman <mojaveazure@users.noreply.github.com>
Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
Co-authored-by: Paul Hoffman <paul.hoffman@tiledb.com>
mojaveazure added a commit that referenced this pull request Aug 26, 2024
* [python] pin `pandas-stubs>=2` during pre-commit `mypy` hook (#2854)

* pin `pandas-stubs>=2` during pre-commit `mypy` hook

also simplify some `if TYPE_CHECKING` blocks

fixes #2839

* add r-ci.yml exclusions

* `actions{cache,checkout,setup-python}` upgrades (#2856)

* CI: use `pip` directly (instead of `python -m pip`)

* CI: checkout@v4, setup-python@v5 cache@v4

* disable setup-python cache for lint/pre-commit

See actions/setup-python#919; setup-python cache likely doesn't help much here, as we only `pip install pre-commit`, and cache `~/.cache/pre-commit` separately using `actions/cache`.

* bump to codecov-action@v4

rm coverage/uploader pin added in #2827, per codecov/uploader#1673 (comment)

* `s/MacOS/macOS/

* fix typo from #2854

* [python] Offer better guidance on attribute names with `.` (#2864)

* [python] Move `_update_column` into pybind11 (#2862)

* [r] Expose `tiledb_timestamp` parameter to `$reopen()`
Allow `$reopen()` to reopen at a particular timestamp; by default, the
timestamp is set to `NULL` to reopen at the curren time. This is needed
for compatibility between libtiledbsoma's timestamp handling and
resume-mode

[SC-52694](https://app.shortcut.com/tiledb-inc/story/52694/allow-reopen-to-take-a-timestamp-for-reopening)

---------

Co-authored-by: Ryan Williams <ryan.williams@tiledb.com>
Co-authored-by: John Kerl <kerl.john.r@gmail.com>
Co-authored-by: nguyenv <vivian@tiledb.com>
@johnkerl johnkerl changed the title actions{cache,checkout,setup-python} upgrades [python] actions{cache,checkout,setup-python} upgrades Sep 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants