Repository navigation

feat(deps): Add arrow-buffer, schema, data, array 39 - #10

Closed

therealhieu wants to merge 92 commits into

ritchie46:polars_2023-05-09from

therealhieu:ritchie-arrow2

Closed

feat(deps): Add arrow-buffer, schema, data, array 39#10
therealhieu wants to merge 92 commits into
ritchie46:polars_2023-05-09from
therealhieu:ritchie-arrow2

Commits on Mar 28, 2023
- fix: fix all on empty boolean array
  ritchie46
  committed
  d4f3906
Commits on Apr 5, 2023
- both kernels
  ritchie46
  committed
  0063967
- Fixed error in memory usage of sliced binary/list/utf8arrays (#1293)
  ritchie46
  committed
  492d130
- Fixed link from the API to the guide (#1290)
  
  datapythonista
  authored and
  ritchie46
  committed
  2847357
- Improved ZipValidity iterators (#1284)
  ritchie46
  committed
  035bcef
- Bumped arrow-format to 0.8 (#1298)
  
  Xuanwo
  authored and
  ritchie46
  committed
  84203dd
- Fixed descending ordering when specify nulls first (#1286)
  
  FANNG1
  authored and
  ritchie46
  committed
  f0a31b6
- Upgraded ahash to v0.8 (#1297)
  
  benesch
  authored and
  ritchie46
  committed
  e7b2829
- Fix deprecated warning from chrono (#1299)
  
  Xuanwo
  authored and
  ritchie46
  committed
  f6d62e6
- Add avro record names when converting arrow schema to avro (#1279)
  
  Samrose-Ahmed
  authored and
  ritchie46
  committed
  caab011
- Added support for Extension types in ffi (#1300)
  
  jondo2010
  authored and
  ritchie46
  committed
  9796928
- Added `reserve` to pushable containers in parquet extend_from_decoder (#1301)
  ritchie46
  committed
  c81556c
- Added data_pagesize_limit to write parquet pages (#1303)
  
  sundy-li
  authored and
  ritchie46
  committed
  9ebb562
- Improved performance of checking offsets `~-64-73%` (#1305)
  ritchie46
  committed
  3b3fa63
- Bumped parquet2 dependency (#1304)
  ritchie46
  committed
  33d856f
- Removed flushing during arrow IPC writing to improve performance when using a buffered writer (#1318)
  
  cyr
  authored and
  ritchie46
  committed
  c7878f8
- Fixed failing to accept dictionary full of nulls (#1312)
  ritchie46
  committed
  69606a4
- Bumped json-deserializer version (#1321)
  
  universalmind303
  authored and
  ritchie46
  committed
  8ea8991
- Added `Offsets` and `OffsetsBuffer` (#1316)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  e68f2c0
- Improved performance of check_indexes (#1313)
  ritchie46
  committed
  13014c3
- add bytes_estimate for binary push in parquet deserialize (#1308)
  
  sundy-li
  authored and
  ritchie46
  committed
  b086679
- fix invalid parquet read (#1330)
  ritchie46
  committed
  5365f4a
- Fixed writing nested/sliced arrays to parquet (#1326)
  ritchie46
  committed
  cbf28db
- Removed `from_data` from all arrays (#1328)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  f210723
- pub `deserialize_schema` (#1335)
  
  sundy-li
  authored and
  ritchie46
  committed
  06d7dfa
- Fixed clippy (#1336)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  4e4c0c4
- Improved `UnionArray` (#1331)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  06ae1b6
- Bumped version
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  c3cb0b0
- Update README.md to fix capitalization and spelling (#1338)
  
  yerke
  authored and
  ritchie46
  committed
  cabd34d
- Make some functions public. (#1339)
  
  RinChanNOWWW
  authored and
  ritchie46
  committed
  fbe2160
- Fix nested extension types (#1334)
  
  John Hughes
  authored and
  ritchie46
  committed
  66059c1
- make finish_eq_validities public (#1340)
  ritchie46
  committed
  b3c3ba6
- Improve primitive filter performance (#1346)
  ritchie46
  committed
  6fd2063
- fix(parquet): nested struct /list writing (#1347)
  ritchie46
  committed
  172e7ed
- feat: add typed dictionary_iter (#1320)
  ritchie46
  committed
  0bf325d
- fix: correct for endiannes in leading ones compute (#1348)
  ritchie46
  committed
  064cdcc
- Improved clippy (#1353)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  9b53030
- Fix incorrect downcast in `estimated_size_bytes` (#1351)
  
  jleibs
  authored and
  ritchie46
  committed
  aeed1b8
- add toolchain.toml (#1349)
  ritchie46
  committed
  d7b83a8
- Added set/get scratches (#1363)
  ritchie46
  committed
  7a9620a
- Amortized intermediate allocations in IPC writer (#1362)
  ritchie46
  committed
  3374e58
- Correctly update child-offsets in `GrowableUnion` (#1360)
  
  Jeremy Leibs
  authored and
  ritchie46
  committed
  4053410
- Fixed csv infer_schema on empty fields (#1342)
  
  tripokey
  authored and
  ritchie46
  committed
  6fe04e0
- Made IPC writer take owned schema (#1361)
  ritchie46
  committed
  20b3884
- Added `Utf8Array::apply_validity` (#1367)
  
  Arty-Maly
  authored and
  ritchie46
  committed
  c05edd4
- Made some structs and functions public (#1375)
  
  b41sh
  authored and
  ritchie46
  committed
  af9a0a0
- Fixed typo in `OffsetsBuffer` docs (#1373)
  
  DzenanJupic
  authored and
  ritchie46
  committed
  2e4f8da
- Added memory mapping a slice into a primitive array (#1378)
  ritchie46
  committed
  87b02c3
- Renamed `factory` argument on parquet read functions to `reader_factory` (#1380)
  
  ozgrakkurt
  authored and
  ritchie46
  committed
  f5f0443
- Added support for `take` of `FixedSizeListArray` (#1386)
  
  kylebarron
  authored and
  ritchie46
  committed
  62907d3
- Made `StructIterator` and `NestedArrayIter` public (#1385)
  
  b41sh
  authored and
  ritchie46
  committed
  11ccacb
- Bumped to 0.16
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  f489f07
- Fixed writing nested parquet (#1390)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  7f7c9be
- Fixed error in writing sliced binary (#1391)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  e8c9892
- Fixed broken guide link (#1395)
  
  kjschiroo
  authored and
  ritchie46
  committed
  b02f887
- Changed methods to slice arrays (#1396)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  f527966
- Fixed writing of sliced arrays to parquet (#1397)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  e622ebd
- Simplified code via DRY (#1398)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  34d2789
- Improved API of getting mutable from Buffer (#1399)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  567706d
- Simplified code (#1401)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  b2d447a
- Improved support for date64 written by pyarrow to parquet (#1402)
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  fdc1a70
- Fixed nested boolean offset (#1404)
  ritchie46
  committed
  86be844
- Added apply_validity and set_validity to mutable utf8 array (#1406)
  
  authored and
  ritchie46
  committed
  6cb72bd
- Fixe ahash dependency for wasm (#1407)
  
  hzuo
  authored and
  ritchie46
  committed
  b6cf662
- Added cast for FixedSizeBinary to (Large)Binary (#1403)
  ritchie46
  committed
  fc83e06
- Updated base64 to 0.21 (#1408)
  
  WindSoilder
  authored and
  ritchie46
  committed
  b93d806
- Fixed statistics writing flag and correct null_count in dictionaries (#1414)
  ritchie46
  committed
  9f48859
- Added convenience accessor array.get (#1416)
  
  ozgrakkurt
  authored and
  ritchie46
  committed
  f87e9d2
- Re-exported the `bloom_filter` module from `parquet2` crate (#1420)
  
  ozgrakkurt
  authored and
  ritchie46
  committed
  9296f39
- Added support for MapArray read and write to parquet (#1419)
  
  b41sh
  authored and
  ritchie46
  committed
  ea0cc67
- Added support for decimal256 read/write in parquet (#1412)
  
  TCeason
  authored and
  ritchie46
  committed
  8018a7f
- Added support for JSON serialization of dictionary (#1424)
  ritchie46
  committed
  f1e9423
- Added MapScalar (#1428)
  
  b41sh
  authored and
  ritchie46
  committed
  a1b9bf1
- Changed encoded float::Inf as null in json (#1427)
  
  SimonSchneider
  authored and
  ritchie46
  committed
  c55377c
- Added `set_len` method to Buffer (#1374)
  
  haixuanTao
  authored and
  ritchie46
  committed
  5ba1a3a
- Fixed issue with Time32/Time64 datatype in csv reader (#1425)
  
  christophe-petitjean
  authored and
  ritchie46
  committed
  ea68a88
- Made `num_values` public (#1431)
  
  b41sh
  authored and
  ritchie46
  committed
  9f9067a
- Made `len/len_proxy` consistent with `Offsets` (#1434)
  ritchie46
  committed
  dbd0228
- Added memmap `&[u8]` as `BooleanArray` (#1436)
  ritchie46
  committed
  20b6d07
- Added impl_mutable_array_mut_validity macro for mutable arrays (#1435)
  
  Arty-Maly
  authored and
  ritchie46
  committed
  3df5d96
- Added buffer interoperability with arrow-rs (#1429) (#1437)
  
  tustvold
  authored and
  ritchie46
  committed
  d1502b7
- Changed async ipc writer to accept schema by value (#1439)
  ritchie46
  committed
  775c112
- Updated multiversion and support wider registers (#1440)
  ritchie46
  committed
  bb22728
- Updated dependencies (#1441)
  ritchie46
  committed
  69b99bc
- Added interoperability with arrow-schema (#1442)
  
  tustvold
  authored and
  ritchie46
  committed
  b9f83db
- Bumped version
  
  jorgecarleitao
  authored and
  ritchie46
  committed
  ffa6d44
- use patched parquet2 version
  ritchie46
  committed
  d0174d3
Commits on May 12, 2023
- feat(deps): bump arrow-rs 39
  Hieu Nguyen
  committed
  e145ec8
- Merge pull request #1 from therealhieu/feat/upgrade-deps
  therealhieu
  authored
  fa8852f
- Merge remote-tracking branch 'ritchie/arrow2/polars_2023-04-05' into ritchie-arrow2
  Hieu Nguyen
  committed
  5f168ec
- Merge remote-tracking branch 'ritchie/arrow2/polars_2023-04-05' into ritchie-arrow2
  Hieu Nguyen
  committed
  4abbe28
- Merge remote-tracking branch 'ritchie/arrow2/polars_2023-05-09' into ritchie-arrow2
  Hieu Nguyen
  committed
  0988348

Commits

Commits on Mar 28, 2023

Commits on Apr 5, 2023

Commits on May 12, 2023