-
Notifications
You must be signed in to change notification settings - Fork 1k
Closed
Description
Describe the bug
DataFusion uses the DateType::try_from
impl to parse Strings to DataTypes
For example, we have a function like this:
select arrow_cast('2021-01-01T00:00:00', 'Timestamp(Nanosecond, Some("-05:00"))'
That parses the string "'Timestamp(Nanosecond, Some("-05:00")"
into the correct DataType::Timestamp
When testing with the latest (unreleased version) of arrow-rs, I found these query fails now with an error similar to
statement error DataFusion error: Execution error: Unsupported type 'Timestamp\(Nanosecond, None\)'\. Must be a supported arrow type name such as 'Int32' or 'Timestamp\(ns\)'\. Error expected double quoted string for Timezone, got 'None'
I found this while testing upgrading DataFusion to arrow (what will be 57) in this PR:
To Reproduce
I am pretty sure this was introduced as part of this PR
Expected behavior
The old types should be supported
Additional context