Skip to content

Conversation

@alexanderbianchi
Copy link

@alexanderbianchi alexanderbianchi commented Jul 31, 2025

Pulling changes from PR apache#16639 which should solve an inconsistency in using to_timestamp with numeric values where the function reads floats in nanoseconds where it should be seconds.

…e#16639)

* Fix discrepancy in Float64 to timestamp(9) casts

Before the change, when casting `Float64` value to
`Timestamp(Nanosecond, None)`, the result would depend on whether the
source value is constant-foldable scalar. This is because
`ScalarValue.cast_to` had a special treatment for that source &
destination type pair, producing a different result from the canonical
one.

* Test Float32 cast to timestamp ntz too

* restore to_timestamp(double) behavior

the function was not meant to be changed

(cherry picked from commit 4e32ab9)
@alexanderbianchi alexanderbianchi changed the base branch from main to branch-48 July 31, 2025 22:39
@alexanderbianchi alexanderbianchi changed the title Bianchi/pick timestamp fix Cherry pick to_timestamp fix for float values Aug 1, 2025
@alexanderbianchi alexanderbianchi merged commit 736c186 into DataDog:branch-48 Aug 1, 2025
41 of 63 checks passed
@gabotechs gabotechs changed the title Cherry pick to_timestamp fix for float values [branch-48] Cherry pick to_timestamp fix for float values Aug 4, 2025
geoffreyclaude pushed a commit that referenced this pull request Sep 2, 2025
* dissallow pushdown of volatile PhysicalExprs

* fix

* add FilteredVec helper to handle filter / remap pattern (#34)

* checkpoint: Address PR feedback in https://github.com/apach...

* add FilteredVec to consolidate handling of filter / remap pattern

* lint

* Add slt test for pushing volatile predicates down (#35)

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
LiaCastaneda pushed a commit that referenced this pull request Sep 2, 2025
* dissallow pushdown of volatile PhysicalExprs

* fix

* add FilteredVec helper to handle filter / remap pattern (#34)

* checkpoint: Address PR feedback in https://github.com/apach...

* add FilteredVec to consolidate handling of filter / remap pattern

* lint

* Add slt test for pushing volatile predicates down (#35)

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
(cherry picked from commit 94e8548)
LiaCastaneda added a commit that referenced this pull request Sep 9, 2025
* Enable physical filter pushdown for hash joins (apache#16954)

(cherry picked from commit b10f453)

* Add ExecutionPlan::reset_state (apache#17028)

* Add ExecutionPlan::reset_state

Co-authored-by: Robert Ream <robert@stably.io>

* Update datafusion/sqllogictest/test_files/cte.slt

* Add reference

* fmt

* add to upgrade guide

* add explain plan, implement in more plans

* fmt

* only explain

---------

Co-authored-by: Robert Ream <robert@stably.io>

* Add dynamic filter (bounds) pushdown to HashJoinExec (apache#16445)

(cherry picked from commit ff77b70)

* Push dynamic pushdown through CooperativeExec and ProjectionExec (apache#17238)

(cherry picked from commit 4bc0696)

* Fix dynamic filter pushdown in HashJoinExec (apache#17201)

(cherry picked from commit 1d4d74b)

* Fix HashJoinExec sideways information passing for partitioned queries (apache#17197)

(cherry picked from commit 64bc58d)

* disallow pushdown of volatile functions (apache#16861)

* dissallow pushdown of volatile PhysicalExprs

* fix

* add FilteredVec helper to handle filter / remap pattern (#34)

* checkpoint: Address PR feedback in https://github.com/apach...

* add FilteredVec to consolidate handling of filter / remap pattern

* lint

* Add slt test for pushing volatile predicates down (#35)

---------

Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
(cherry picked from commit 94e8548)

* fix bounds accumulator reset in HashJoinExec dynamic filter pushdown (apache#17371)

---------

Co-authored-by: Adrian Garcia Badaracco <1755071+adriangb@users.noreply.github.com>
Co-authored-by: Robert Ream <robert@stably.io>
Co-authored-by: Jack Kleeman <jackkleeman@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants