Skip to content

Move V3 development to main #2341

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 269 commits into from
Oct 14, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
269 commits
Select commit Hold shift + click to select a range
3a73950
Allow dmypy to be run (#1780)
dstansby Apr 11, 2024
3a9d968
Remove unused typing ignore comments (#1781)
dstansby Apr 11, 2024
ce6fcbb
Check untyped defs (#1784)
dstansby Apr 12, 2024
a33ebf2
[v3] Enable some more strict mypy options (#1793)
dstansby Apr 19, 2024
136daec
implement __eq__ for LocalStore (#1792)
Charoula-Kyriakides Apr 21, 2024
472ab13
moves v3 tests
normanrz Apr 22, 2024
368b170
Remove old v3 (#1742)
d-v-b Apr 22, 2024
f046322
Disallow generic Any typing (#1794)
dstansby Apr 22, 2024
f7993db
V3 update pre commit (#1808)
jhamman Apr 23, 2024
d1a0d99
V3 reorg (#1809)
jhamman Apr 23, 2024
0f755cc
[v3] Sync with futures (#1804)
d-v-b Apr 24, 2024
57d6ace
implement `group.members` (#1726)
d-v-b Apr 24, 2024
096c900
remove windows testing on v3 branch (#1817)
jhamman Apr 24, 2024
5889e96
Disallow incomplete type definitions (#1814)
dstansby Apr 30, 2024
c1323c4
fix: add mypy to test dependencies (#1789)
d-v-b May 2, 2024
f44fd09
Disallow untyped calls (#1811)
dstansby May 3, 2024
19a28df
chore(ci): add numpy 2 release candidate to test matrix (#1828)
jhamman May 6, 2024
dd0ea50
fix dependencies (#1840)
normanrz May 6, 2024
7e944f0
Add pytest to mypy dependencies (#1846)
dstansby May 7, 2024
4f5ca4b
chore(pre-commit): update pre-commit versions and remove attrs dep my…
jhamman May 7, 2024
8d483c9
Remove implicit groups (#1827)
jhamman May 7, 2024
3499acb
feature(store): list_* -> AsyncGenerators (#1844)
jhamman May 7, 2024
fcab650
adds test for codec entrypoint (#1835)
normanrz May 8, 2024
666a8b9
Remove extra v3 sync module (#1856)
maxrjones May 8, 2024
5bb3375
Use donfig for V3 configuration (#1855)
maxrjones May 10, 2024
f632771
Disallow any generics in zarr.array (#1861)
dstansby May 11, 2024
8da3df6
Fix some untyped calls (#1865)
dstansby May 12, 2024
0bb2be2
chore: update project settings per scientific python repo-review (#1863)
jhamman May 13, 2024
5a39ff6
Disallow untyped defs (#1834)
dstansby May 14, 2024
c31a785
Enable some ruff rules (RUF) and fix issues (#1869)
DimitriPapadopoulos May 14, 2024
f3305d9
groundwork for V3 group tests (#1743)
d-v-b May 15, 2024
67b07fb
Add more typing to zarr.group (#1870)
dstansby May 15, 2024
ceee364
[v3] First step to generalizes ndarray and bytes (#1826)
madsbk May 16, 2024
846c085
Reworked codec pipelines (#1670)
normanrz May 17, 2024
69ad5e7
Configure Ruff to apply flake8-bugbear/isort/pyupgrade (#1890)
normanrz May 17, 2024
ea2da93
chore(ci): remove mypy from test action in favor of pre-commit settin…
jhamman May 17, 2024
333f37f
Enable ruff/flake8-raise rules (RSE) and fix issues (#1872)
DimitriPapadopoulos May 17, 2024
88946d2
Apply assorted ruff/refurb rules (FURB) (#1873)
DimitriPapadopoulos May 17, 2024
50b3fb1
Enable ruff/flake8-implicit-str-concat rules (ISC) and fix issues (#1…
DimitriPapadopoulos May 17, 2024
55f4913
Remove some unused mypy overrides (#1894)
dstansby May 21, 2024
549cf28
Finish typing zarr.metadata (#1880)
dstansby May 21, 2024
0c513fc
Followup on codecs (#1889)
normanrz May 21, 2024
c2e03c3
Add numpy to mypy pre-commit check env (#1893)
dstansby May 22, 2024
4da9505
remove fixture files from src (#1897)
d-v-b May 22, 2024
b1f4c50
Protocols for `Buffer` and `NDBuffer` (#1899)
madsbk May 22, 2024
fc7fa4f
[V3] Expand store tests (#1900)
d-v-b May 28, 2024
ef15e20
[v3] Feature: Store open mode (#1911)
jhamman May 29, 2024
14e2ed3
chore: update pre-commit hooks (#1920)
pre-commit-ci[bot] May 31, 2024
9ad01f1
Disallow implicit re-exports (#1908)
dstansby May 31, 2024
016964b
Make typing strict (#1879)
dstansby Jun 1, 2024
b4cdf94
Enable extra mypy error codes (#1909)
dstansby Jun 1, 2024
2060a53
fix(types): Group.info -> NotImplementedError (#1936)
jhamman Jun 1, 2024
54a0958
Enable warn_unreachable for mypy (#1937)
dstansby Jun 1, 2024
67d521e
Run sphinx directly on readthedocs (#1919)
dstansby Jun 1, 2024
2bac074
Fix list of packages in mypy pre-commit environment (#1907)
dstansby Jun 1, 2024
bd6cf32
Bump the actions group with 6 updates (#1904)
dependabot[bot] Jun 1, 2024
19365e2
Fix final typing errors (#1939)
dstansby Jun 1, 2024
c2a1d2e
feature(typing): add py.typed file to package root (#1935)
jhamman Jun 2, 2024
bd20e46
Apply preview ruff rules (#1942)
DimitriPapadopoulos Jun 2, 2024
56d36e3
Enable and apply ruff rule RUF009 (#1941)
DimitriPapadopoulos Jun 2, 2024
24e855c
Support all indexing variants (#1917)
normanrz Jun 3, 2024
72005d7
Feature: group and array name properties (#1940)
jhamman Jun 3, 2024
da9885c
implement .chunks on v3 arrays (#1929)
rabernat Jun 3, 2024
8599944
chore: update pre-commit hooks (#1948)
pre-commit-ci[bot] Jun 3, 2024
5c4dc23
fixes bug in transpose (#1949)
normanrz Jun 4, 2024
b431cf7
Create issue-metrics.yml
jhamman Jun 4, 2024
661acb3
Buffer Prototype Argument (#1910)
madsbk Jun 4, 2024
ee30347
Feature: Top level V3 API (#1884)
jhamman Jun 7, 2024
7ded5d6
Basic working FsspecStore (#1785)
martindurant Jun 11, 2024
5ccd83c
doc: update release notes for 3.0.0.alpha (#1959)
jhamman Jun 12, 2024
1948628
Update release.rst (#1960)
sanketverma1704 Jun 12, 2024
f648b61
chore: update pre-commit hooks (#1957)
pre-commit-ci[bot] Jun 12, 2024
ef1817c
Bump pypa/gh-action-pypi-publish in the actions group (#1969)
dependabot[bot] Jun 17, 2024
143faea
chore: update pre-commit hooks (#1973)
pre-commit-ci[bot] Jun 17, 2024
ba6b5c0
add json indentation to config (#1952)
d-v-b Jun 18, 2024
d4c25b2
Clean up typing and docs for indexing (#1961)
brokkoli71 Jun 19, 2024
6fc05b7
`parse_shapelike` allows 0 (#1979)
d-v-b Jun 21, 2024
65dc4cc
0 dim arrays: indexing (#1980)
d-v-b Jun 22, 2024
8aadd15
[v3] Elevate codec pipeline (#1932)
d-v-b Jun 23, 2024
ea6b441
Update `RemoteStore.__str__` and add UPath tests (#1964)
d-v-b Jun 23, 2024
11a959a
Automatically generate API reference docs (#1918)
dstansby Jun 24, 2024
cb9605e
Fix doc build warnings (#1985)
dstansby Jun 24, 2024
e3ee09e
Fix doc build (#1987)
dstansby Jun 24, 2024
c677da4
[v3] `Buffer` ensure correct subclass based on the `BufferPrototype` …
madsbk Jun 25, 2024
5a4a50f
Allow 'chunks' as an alias for 'chunk_shape' in array creation. (#1991)
tomwhite Jun 25, 2024
bc30f2e
Use f-strings instead of legacy interpolation (#1995)
DimitriPapadopoulos Jun 26, 2024
b1bb15a
Unnecessary use of a comprehension (#1994)
DimitriPapadopoulos Jun 26, 2024
50235c0
Handle Path in `make_store_path` (#1992)
tomwhite Jun 26, 2024
61b9404
Unnecessary comprehension (#1996)
DimitriPapadopoulos Jun 27, 2024
b3010fc
Merge collapsible if statements (#1999)
DimitriPapadopoulos Jun 27, 2024
d6201ac
Stop ignoring these ruff rules (#2001)
DimitriPapadopoulos Jun 27, 2024
f0dd375
Unnecessary comprehension (#1997)
DimitriPapadopoulos Jun 27, 2024
08b5763
Fix string interpolation (#1998)
DimitriPapadopoulos Jun 27, 2024
e42a6be
Fix indexing with bools (#1968)
brokkoli71 Jun 28, 2024
0c5b0e6
chore: update pre-commit hooks (#1989)
pre-commit-ci[bot] Jul 1, 2024
6c2ca63
Bump NumPy to 2.0 (#1983)
jhamman Jul 1, 2024
ace96f5
build(ci): enable python 3.12 in github actions (#2005)
jhamman Jul 2, 2024
22e3fc5
doc: copy 3.0.0.alpha changelog into release.rst (#2007)
jhamman Jul 3, 2024
e84057a
make shardingcodec pickleable (#2011)
d-v-b Jul 5, 2024
33b1589
chore: update pre-commit hooks (#2017)
pre-commit-ci[bot] Jul 8, 2024
b8baa68
Cast fill value to array's dtype (#2020)
d-v-b Jul 10, 2024
37a8441
chore: update pre-commit hooks (#2039)
pre-commit-ci[bot] Jul 16, 2024
eec0f41
Redundant list comprehension (#2048)
DimitriPapadopoulos Jul 21, 2024
4b7be5b
Multiple imports for an import name (#2047)
DimitriPapadopoulos Jul 21, 2024
48e2475
Move fixtures to `tests` (#1813)
d-v-b Jul 21, 2024
5b9b6c4
Apply ruff/flake8-bandit rule B006 (#2049)
DimitriPapadopoulos Jul 22, 2024
df4c25f
chore: update pre-commit hooks (#2051)
pre-commit-ci[bot] Jul 22, 2024
aef47ac
[v2 / v3 compat] add `Group.array` and `data` kwarg to array creation…
d-v-b Jul 26, 2024
325786a
fix file modes (#2000)
brokkoli71 Jul 26, 2024
cbc0887
Use config to select implementation (#1982)
brokkoli71 Jul 26, 2024
0e18671
Handle missing attributes key from metadata, and other fixes (#2058)
d-v-b Jul 30, 2024
064b2e0
chore: update pre-commit hooks (#2057)
pre-commit-ci[bot] Aug 6, 2024
334d6fe
Add hypothesis property tests (#1746)
dcherian Aug 8, 2024
5cf2ef1
Fix low contrast in dark theme h3 headings (#2003)
dstansby Aug 9, 2024
f6de884
Fixed dependencies (#2069)
TomAugspurger Aug 9, 2024
d9a142a
Remove zstandard dependency in favor of numcodecs (#1838)
normanrz Aug 11, 2024
ff462cc
Enforce ruff/tryceratops rules (TRY) (#2054)
DimitriPapadopoulos Aug 11, 2024
035e2f8
chore: update pre-commit hooks (#2080)
pre-commit-ci[bot] Aug 12, 2024
10ae5f3
[v3] reorganize package - move most modules to zarr.core (#2072)
jhamman Aug 14, 2024
9d0a050
Re-enable dependabot on main branch (#2082)
dstansby Aug 15, 2024
681f286
Stateful store tests (#2070)
e-marshall Aug 15, 2024
61683be
Fixed MemoryStore.list_dir (#2117)
TomAugspurger Aug 26, 2024
0095ee6
Feature/recursive members (#2118)
TomAugspurger Aug 29, 2024
b1f26c0
Fix dtype type error (#2136)
dstansby Aug 29, 2024
6ea9997
mypy fixes for NumPy 2.1.0 (#2139)
TomAugspurger Aug 30, 2024
2f9cf22
Initial GPU support (#1967)
akshaysubr Aug 30, 2024
0b5483a
[v3] clean up `create_array` signatures in group/asyncgroup classes (…
jhamman Aug 30, 2024
77f188c
Bump pypa/gh-action-pypi-publish from 1.9.0 to 1.10.0 in the actions …
dependabot[bot] Sep 2, 2024
60b4f57
chore: update pre-commit hook (#2148)
DimitriPapadopoulos Sep 2, 2024
3b793c1
[v3] h5py compat methods on Group (#2128)
jhamman Sep 4, 2024
de075de
Enforce Repo-Review rules (#2075)
DimitriPapadopoulos Sep 5, 2024
c08b008
Enforce ruff/flake8-type-checking rules (TCH) (#2110)
DimitriPapadopoulos Sep 6, 2024
5e113f5
Add UPath dependency/type checking (#1955)
dstansby Sep 6, 2024
e8800b0
Check tests folder with mypy (#2150)
TomAugspurger Sep 6, 2024
59b118d
Fix new ruff/flake8-type-checking TCH003 error (#2154)
DimitriPapadopoulos Sep 6, 2024
8e29f37
Autogenerate all API docs (#2002)
dstansby Sep 8, 2024
fb9c526
Bump pypa/gh-action-pypi-publish from 1.10.0 to 1.10.1 in the actions…
dependabot[bot] Sep 9, 2024
ac6c6a3
Ensure that store_dict used for empty dicts (#2162)
TomAugspurger Sep 9, 2024
c2d50a6
chore: update pre-commit hooks (#2165)
pre-commit-ci[bot] Sep 10, 2024
8403438
Fixed test warnings (#2168)
TomAugspurger Sep 11, 2024
67819a1
Fixed path segment duplication in open_array (#2167)
TomAugspurger Sep 11, 2024
726fdfb
Simplify mypy config for tests (#2156)
dstansby Sep 11, 2024
c62294e
Accept dictionaries for `store` argument (#2164)
TomAugspurger Sep 12, 2024
52d6849
refactor: split metadata into v2 and v3 modules (#2163)
d-v-b Sep 12, 2024
534e0cd
More typing fixes for tests (#2173)
dstansby Sep 13, 2024
f1bd703
feature(store): V3 ZipStore (#2078)
jhamman Sep 13, 2024
ceb3b36
test: check that store, array, and group classes are serializable (#…
jhamman Sep 14, 2024
b1ecdd5
fix: opening a group with unspecified format finds either v2 or v3 (#…
jhamman Sep 14, 2024
fbd1658
chore: update pre-commit hooks (#2188)
pre-commit-ci[bot] Sep 17, 2024
bc82d02
fix: replace tests that went missing in #2006 (#2192)
jhamman Sep 17, 2024
dd03ff0
Silence hypothesis complex warning (#2157)
dcherian Sep 17, 2024
8c5038a
Narrow JSON type, ensure that `to_dict` always returns a dict, and v2…
d-v-b Sep 17, 2024
0903dd6
Fixed codec for v2 data with no fill value (#2207)
TomAugspurger Sep 19, 2024
06e3215
implement `store.list_prefix` and `store._set_many` (#2064)
d-v-b Sep 19, 2024
54060d3
[v3] Implement Group methods for empty, full, ones, and zeros (#2210)
lindseynield Sep 19, 2024
f894335
Make MemoryStore serialiazable (#2204)
TomAugspurger Sep 19, 2024
f538662
Default to RemoteStore for fsspec URIs (#2198)
TomAugspurger Sep 19, 2024
32540b4
Typing fixes to test_indexing (#2193)
dstansby Sep 19, 2024
c878da2
Make Group.arrays, groups compatible with v2 (#2213)
TomAugspurger Sep 20, 2024
6900754
Basic Zarr-python 2.x compatibility changes (#2098)
TomAugspurger Sep 20, 2024
fb28fa5
fix typo in store integration test (#2223)
dcherian Sep 23, 2024
2d3a36c
fix: validate v3 dtypes when loading/creating v3 metadata (#2209)
jhamman Sep 23, 2024
cd7321b
chore: update pre-commit hooks (#2222)
pre-commit-ci[bot] Sep 23, 2024
2a78497
Added Attributes.asdict (#2221)
TomAugspurger Sep 24, 2024
ee2a3c6
Bump pypa/gh-action-pypi-publish in the actions group (#2219)
dependabot[bot] Sep 24, 2024
a4b2509
Fix/empty listdir (#2225)
jhamman Sep 24, 2024
30e2bc3
remove outdated v2 source code and tests from v3 branch (#2182)
jhamman Sep 24, 2024
5e57f75
fix: selection with zarr arrays (#2137)
jhamman Sep 24, 2024
4cbb17e
Apply and enforce more ruff rules (#2053)
DimitriPapadopoulos Sep 24, 2024
fafd0bf
Update V2 codec pipeline to use concrete classes (#2244)
TomAugspurger Sep 25, 2024
692593b
Fix fill_value handling for complex dtypes (#2200)
dcherian Sep 25, 2024
1569eca
Enforce ruff/flynt rules (FLY) (#2240)
DimitriPapadopoulos Sep 25, 2024
1d9658b
Enforce ruff/flake8-return rules (RET) (#2237)
DimitriPapadopoulos Sep 25, 2024
c06fa23
Fix multiple identical imports (#2241)
DimitriPapadopoulos Sep 25, 2024
9f825e1
Enforce ruff/flake8-pytest-style rules (PT) (#2236)
DimitriPapadopoulos Sep 25, 2024
1574e8b
Replace Gitter with Zulip (#2254)
sanketverma1704 Sep 25, 2024
3ce7670
Use `map(str, *)` in `test_accessed_chunks` (#2229)
jakirkham Sep 25, 2024
e968ac5
Enforce ruff/flake8-comprehensions rules (C4) (#2239)
DimitriPapadopoulos Sep 25, 2024
c3f5401
Remove unnecessary lambda expression (#2260)
DimitriPapadopoulos Sep 26, 2024
265837c
No need to run DeepSource any more - we use ruff (#2261)
DimitriPapadopoulos Sep 26, 2024
19ed733
Apply ruff/flake8-annotations rule ANN204 (#2258)
DimitriPapadopoulos Sep 26, 2024
f0443db
Add array storage helpers (#2065)
d-v-b Sep 26, 2024
3365928
Apply assorted ruff/flake8-simplify rules (SIM) (#2259)
DimitriPapadopoulos Sep 26, 2024
6984294
feature(store): add LoggingStore wrapper (#2231)
jhamman Sep 26, 2024
0e4cc7e
chore(deps): drop support for python 3.10 and numpy 1.24 (#2217)
jhamman Sep 26, 2024
4515671
fix(async): set default concurrency to 10 tasks (#2256)
jhamman Sep 26, 2024
5ca080d
feat: metadata-only support for storage transformers metadata (#2180)
d-v-b Sep 27, 2024
1560d21
Default zarr.open to open_group if shape is not provided (#2158)
agoodm Sep 27, 2024
b6350a1
Generalize stateful store test (#2202)
dcherian Sep 27, 2024
177a8c2
Enforce ruff/flake8-annotations rules (ANN) (#2264)
DimitriPapadopoulos Sep 27, 2024
c52614a
Added a new issue template for documentation issues (#2255)
sanketverma1704 Sep 27, 2024
8e2c660
Apply new ruff rules (preview mode) (#2235)
DimitriPapadopoulos Sep 27, 2024
2edc548
Ensure parents are created when creating a node (#2262)
TomAugspurger Sep 27, 2024
73b884b
Allow mode casting for `Store`s (#2249)
TomAugspurger Sep 27, 2024
6454c69
Bump verison of autoapi used to build docs (#2177)
dstansby Sep 29, 2024
97246cb
Bump the actions group across 1 directory with 2 updates (#2257)
dependabot[bot] Sep 30, 2024
2761845
chore: update pre-commit hooks (#2277)
pre-commit-ci[bot] Sep 30, 2024
f3a2e0a
[v3] fix: zarr v2 compatibility fixes for Dask (#2186)
jhamman Oct 1, 2024
b1c4e47
Fix low contrast box titles (#2287)
dstansby Oct 1, 2024
f13e954
Ignore extra keys in v2 metadata (#2297)
TomAugspurger Oct 2, 2024
d2cff48
Remove acknowledgements page from docs (#2293)
dstansby Oct 3, 2024
8dd1f24
Add maximum character length for signatures in docs (#2299)
dstansby Oct 3, 2024
01346dd
Change ArrayV3Metadata.data_type to DataType (#2278)
rabernat Oct 4, 2024
046c174
Add BaseCodec to the docs (#2290)
dstansby Oct 5, 2024
a24e194
Bump pypa/gh-action-pypi-publish in the actions group (#2305)
dependabot[bot] Oct 7, 2024
1674282
fix: array creation prototype (#2306)
jhamman Oct 7, 2024
cc50b41
base64 encode fill value for some dtypes with `zarr_format=2` (#2286)
TomAugspurger Oct 7, 2024
c258b27
chore: update pre-commit hooks (#2307)
pre-commit-ci[bot] Oct 8, 2024
7e2be57
Add `string` and `bytes` dtypes plus `vlen-utf8` and `vlen-bytes` cod…
rabernat Oct 8, 2024
5a134bf
fix: add get(key, default) method to Group APIs (#2311)
jhamman Oct 8, 2024
8f4ef26
fix(storage): change StoreTests get/set methods to async (#2313)
jhamman Oct 9, 2024
aa46b45
fix(store): speed up Store.open by avoiding empty/clear calls unless …
jhamman Oct 9, 2024
2e1ee2f
Keyword argument defined before variable positional arguments (#2321)
DimitriPapadopoulos Oct 9, 2024
66afca6
Assigning the same variable to itself (#2320)
DimitriPapadopoulos Oct 9, 2024
8362f0a
Apply ruff rules (RUF) (#2319)
DimitriPapadopoulos Oct 9, 2024
75a5a2a
Unnecessary lambda expression (#2318)
DimitriPapadopoulos Oct 9, 2024
9bce890
Add some numpydoc validation checks (#2316)
dstansby Oct 9, 2024
81a87d6
Use implicit fill values for zarr v2 (#2274)
TomAugspurger Oct 10, 2024
395604d
zarr.open should fall back to opening a group (#2310)
TomAugspurger Oct 10, 2024
6b11bb8
Refactor/rename v2 metadata fields (#2301)
d-v-b Oct 10, 2024
3964eab
Zarr-v3 Consolidated Metadata (#2113)
TomAugspurger Oct 10, 2024
b8f6cb9
feature(threading): use explicit/configurable thread pool executor (#…
jhamman Oct 10, 2024
cef4552
fix(RemoteStore): avoid listing all objects in remote store in empty(…
jhamman Oct 10, 2024
bc938bd
fix(attrs): update array attrs in place (#2329)
jhamman Oct 11, 2024
c2c5520
Use horizontal logo for docs (#2333)
dstansby Oct 11, 2024
0e52e52
Merge branch 'main' of https://github.com/zarr-developers/zarr-python…
jhamman Oct 11, 2024
7bcb92b
remove zarr.types from v2
jhamman Oct 11, 2024
0c679c8
Special case `str` dtype in array creation (#2323)
TomAugspurger Oct 11, 2024
42ab847
Add guide section to top level of docs (#2332)
dstansby Oct 11, 2024
979b6f2
Ensure paths created (#2337)
TomAugspurger Oct 11, 2024
ce5f53e
V3 main sync w/ merge (#2335)
jhamman Oct 11, 2024
124640a
Revert "V3 main sync w/ merge (#2335)" (#2339)
jhamman Oct 11, 2024
437234a
Merge branch 'v3' of https://github.com/zarr-developers/zarr-python i…
jhamman Oct 11, 2024
3b787a4
Merge pull request #2340 from jhamman/v3-main-sync-merge
jhamman Oct 11, 2024
d901734
fix RemoteStore.empty
rabernat Oct 12, 2024
5ec909a
test
jhamman Oct 13, 2024
d2dc162
document storage classes and some developer apis (#2279)
jhamman Oct 13, 2024
76f835c
feature(logging): include keys in logging store logs
jhamman Oct 13, 2024
04b12d3
Merge branch 'v3' of https://github.com/zarr-developers/zarr-python i…
jhamman Oct 13, 2024
20d8392
fix bad merge
jhamman Oct 13, 2024
ad68a33
Merge pull request #2355 from jhamman/fix/logging_store_improvements
jhamman Oct 13, 2024
9bbfd88
Merge pull request #2343 from rabernat/ryan/fix-remote-store-exists
jhamman Oct 13, 2024
d78d177
fix(consolidated metadata): skip .zmetadata key in members search
jhamman Oct 13, 2024
b6e8935
test + userwarning
jhamman Oct 13, 2024
2b1e90b
fixup tests
jhamman Oct 13, 2024
b26cf98
Merge pull request #2356 from jhamman/fix/consolidated-metadata-members
jhamman Oct 14, 2024
016ec25
Update deprecated stage names (#2362)
DimitriPapadopoulos Oct 14, 2024
243ee1b
Multiple imports for an import name (#2361)
DimitriPapadopoulos Oct 14, 2024
c646028
Fix logo height in doc navbar (#2352)
dstansby Oct 14, 2024
840a3f7
Bump sphinx from 8.0.2 to 8.1.3 in the actions group across 1 directo…
dependabot[bot] Oct 14, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
The diff you're trying to view is too large. We only load the first 3000 changed files.
7 changes: 0 additions & 7 deletions .deepsource.toml

This file was deleted.

2 changes: 0 additions & 2 deletions .flake8

This file was deleted.

2 changes: 2 additions & 0 deletions .git-blame-ignore-revs
Original file line number Diff line number Diff line change
@@ -1,2 +1,4 @@
# lint codebase with black and ruff
4e348d6b80c96da461fd866576c971b8a659ba15
# migrate from black to ruff format
22cea005629913208a85799372e045f353744add
4 changes: 4 additions & 0 deletions .git_archival.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
node: $Format:%H$
node-date: $Format:%cI$
describe-name: $Format:%(describe:tags=true,match=*[0-9]*)$
ref-names: $Format:%D$
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
*.py linguist-language=python
*.ipynb linguist-documentation
.git_archival.txt export-subst
4 changes: 2 additions & 2 deletions .github/ISSUE_TEMPLATE/bug_report.yml
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
name: 🐛 File a bug report
description: X's behavior is deviating from its documented behavior.
name: Bug Report
description: Report incorrect behaviour in the library.
labels: ["bug"]
body:
- type: markdown
Expand Down
8 changes: 4 additions & 4 deletions .github/ISSUE_TEMPLATE/config.yml
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
blank_issues_enabled: true
contact_links:
- name: Propose a new major feature
- name: Propose a new major feature
url: https://github.com/zarr-developers/zarr-specs
about: A new major feature should be discussed in the Zarr specifications repository.
- name: Discuss something on Zulip
- name: Discuss something on ZulipChat
url: https://ossci.zulipchat.com/
about: For questions like "How do I do X with Zarr?", you can move to our Zulip Chat.
- name: Discuss something on GitHub Discussions
about: For questions like "How do I do X with Zarr?", you can move to our ZulipChat.
- name: Discuss something on GitHub Discussions
url: https://github.com/zarr-developers/zarr-python/discussions
about: For questions like "How do I do X with Zarr?", you can move to GitHub Discussions.
18 changes: 18 additions & 0 deletions .github/ISSUE_TEMPLATE/documentation.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
name: Documentation Improvement
description: Report missing or wrong documentation. Alternatively, you can just open a pull request with the suggested change.
title: "DOC: "
labels: [documentation, help wanted]

body:
- type: textarea
attributes:
label: Describe the issue linked to the documentation
description: >
Please provide a description of what documentation you believe needs to be fixed/improved.
validations:
required: true
- type: textarea
attributes:
label: Suggested fix for documentation
description: >
Please explain the suggested fix and why it's better than the existing documentation.
25 changes: 25 additions & 0 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,28 @@
---
version: 2
updates:
# Updates for v3 branch (the default branch)
- package-ecosystem: "pip"
directory: "/"
schedule:
interval: "daily"
groups:
actions:
patterns:
- "*"
- package-ecosystem: "github-actions"
directory: "/"
schedule:
interval: "weekly"
groups:
actions:
patterns:
- "*"

# Same updates, but for main branch
- package-ecosystem: "pip"
directory: "/"
target-branch: "main"
schedule:
interval: "daily"
groups:
Expand All @@ -11,5 +31,10 @@ updates:
- "*"
- package-ecosystem: "github-actions"
directory: "/"
target-branch: "main"
schedule:
interval: "weekly"
groups:
actions:
patterns:
- "*"
66 changes: 66 additions & 0 deletions .github/workflows/gpu_test.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: GPU Test V3

on:
push:
branches: [ v3 ]
pull_request:
branches: [ v3 ]
workflow_dispatch:

env:
LD_LIBRARY_PATH: /usr/local/cuda/extras/CUPTI/lib64:/usr/local/cuda/lib64

concurrency:
group: ${{ github.workflow }}-${{ github.ref }}
cancel-in-progress: true

jobs:
test:
name: py=${{ matrix.python-version }}, np=${{ matrix.numpy-version }}, deps=${{ matrix.dependency-set }}

runs-on: gpu-runner
strategy:
matrix:
python-version: ['3.11']
numpy-version: ['2.0']
dependency-set: ["minimal"]

steps:
- uses: actions/checkout@v4
# - name: cuda-toolkit
# uses: Jimver/cuda-toolkit@v0.2.16
# id: cuda-toolkit
# with:
# cuda: '12.4.1'
- name: Set up CUDA
run: |
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda-toolkit-12-6
echo "/usr/local/cuda/bin" >> $GITHUB_PATH
- name: GPU check
run: |
nvidia-smi
echo $PATH
echo $LD_LIBRARY_PATH
nvcc -V
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: 'pip'
- name: Install Hatch and CuPy
run: |
python -m pip install --upgrade pip
pip install hatch
- name: Set Up Hatch Env
run: |
hatch env create gputest.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }}
hatch env run -e gputest.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }} list-env
- name: Run Tests
run: |
hatch env run --env gputest.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }} run-coverage
84 changes: 84 additions & 0 deletions .github/workflows/hypothesis.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
name: Slow Hypothesis CI
on:
push:
branches:
- "main"
- "v3"
pull_request:
branches:
- "main"
- "v3"
types: [opened, reopened, synchronize, labeled]
schedule:
- cron: "0 0 * * *" # Daily “At 00:00” UTC
workflow_dispatch: # allows you to trigger manually

env:
FORCE_COLOR: 3

jobs:

hypothesis:
name: Slow Hypothesis Tests
runs-on: "ubuntu-latest"
defaults:
run:
shell: bash -l {0}

strategy:
matrix:
python-version: ['3.11']
numpy-version: ['1.26']
dependency-set: ["optional"]

steps:
- uses: actions/checkout@v4
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}
cache: 'pip'
- name: Install Hatch
run: |
python -m pip install --upgrade pip
pip install hatch
- name: Set Up Hatch Env
run: |
hatch env create test.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }}
hatch env run -e test.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }} list-env
# https://github.com/actions/cache/blob/main/tips-and-workarounds.md#update-a-cache
- name: Restore cached hypothesis directory
id: restore-hypothesis-cache
uses: actions/cache/restore@v4
with:
path: .hypothesis/
key: cache-hypothesis-${{ runner.os }}-${{ github.run_id }}
restore-keys: |
cache-hypothesis-

- name: Run slow Hypothesis tests
if: success()
id: status
run: |
hatch env run --env test.py${{ matrix.python-version }}-${{ matrix.numpy-version }}-${{ matrix.dependency-set }} run-hypothesis

# explicitly save the cache so it gets updated, also do this even if it fails.
- name: Save cached hypothesis directory
id: save-hypothesis-cache
if: always() && steps.status.outcome != 'skipped'
uses: actions/cache/save@v4
with:
path: .hypothesis/
key: cache-hypothesis-${{ runner.os }}-${{ github.run_id }}

- name: Generate and publish the report
if: |
failure()
&& steps.status.outcome == 'failure'
&& github.event_name == 'schedule'
&& github.repository_owner == 'zarr-developers'
uses: xarray-contrib/issue-from-pytest-log@v1
with:
log-path: output-${{ matrix.python-version }}-log.jsonl
issue-title: "Nightly Hypothesis tests failed"
issue-label: "topic-hypothesis"
42 changes: 42 additions & 0 deletions .github/workflows/issue-metrics.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,42 @@
name: Monthly issue metrics
on:
workflow_dispatch:
schedule:
- cron: '3 2 1 * *'

permissions:
contents: read

jobs:
build:
name: issue metrics
runs-on: ubuntu-latest
permissions:
issues: write
pull-requests: read
steps:
- name: Get dates for last month
shell: bash
run: |
# Calculate the first day of the previous month
first_day=$(date -d "last month" +%Y-%m-01)

# Calculate the last day of the previous month
last_day=$(date -d "$first_day +1 month -1 day" +%Y-%m-%d)

#Set an environment variable with the date range
echo "$first_day..$last_day"
echo "last_month=$first_day..$last_day" >> "$GITHUB_ENV"

- name: Run issue-metrics tool
uses: github/issue-metrics@v3
env:
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}
SEARCH_QUERY: 'repo:zarr-developers/zarr-python is:issue created:${{ env.last_month }} -reason:"not planned"'

- name: Create issue
uses: peter-evans/create-issue-from-file@v5
with:
title: Monthly issue metrics report
token: ${{ secrets.GITHUB_TOKEN }}
content-filepath: ./issue_metrics.md
41 changes: 0 additions & 41 deletions .github/workflows/minimal.yml

This file was deleted.

Loading
Loading