You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Dataset filters on partition values can be hard to define using pyarrow.
Eg. type=0/date=2023-01-01/0.parquet needs filters ("type", "=", 0) and ("date", "=", "2023-01-01").
Can Arrow support ("type", "=", "0") and ("date", "=", datetime.date.today()) as well? My understanding is that these need only missing equal (lt, gt) kernel implementations.
I had the errors using pyarrow 11.0.0
Component(s)
C++, Python
The text was updated successfully, but these errors were encountered:
Describe the enhancement requested
Dataset filters on partition values can be hard to define using pyarrow.
Eg.
type=0/date=2023-01-01/0.parquet
needs filters("type", "=", 0)
and("date", "=", "2023-01-01")
.Can Arrow support
("type", "=", "0")
and("date", "=", datetime.date.today())
as well? My understanding is that these need only missing equal (lt, gt) kernel implementations.I had the errors using pyarrow 11.0.0
Component(s)
C++, Python
The text was updated successfully, but these errors were encountered: