feat: Update for Datafusion v50 #109
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
peasee
commented
Oct 27, 2025
peasee
commented
- Applies cherry picks for fixes which aren't yet upstreamed, or which did not make the v50 cut.
fix: More dangling references (#54) UPSTREAM NOTE: This PR was attempted to be upstreamed in apache#13405 - but it was not accepted due to the complexity it brought. Phillip needs to figure out what a good solution that solves our problem and can be upstreamed is.
… ListingTableProvider (#74) UPSTREAM NOTE: This PR was attempted to be upstreamed but was not accepted. Needs to be applied manually apache#15181
UPSTREAM NOTE: Upstream PR has been created but not merged yet. Should be available in DF49 apache#15980
…81) UPSTREAM NOTE: Upstream PR has been created but not merged yet. Should be available in DF49 apache#15980
UPSTREAM NOTE: This was attempted to be fixed with apache#15008 but was closed This is the tracking issue on DataFusion: apache#14895 Do not double alias Exprs
UPSTREAM NOTE: This will not be upstreamed as is.
UPSTREAM NOTE: This has not been submitted upstream yet.
…pes based on their expression (#88) UPSTREAM NOTE: This has not been submitted upstream yet.
UPSTREAM NOTE: This has not been submitted upstream yet.
… types (#96) UPSTREAM NOTE: This was submitted upstream and should be available in DF50 apache#17306
…pes based on their expression (#88) UPSTREAM NOTE: This has not been submitted upstream yet.
* use UDTF function args in LogicalPlan::TableScan name * update test snapshots
* Use text for sqlite timestamp * Add test
This reverts commit d780cc2.
* support ExprNamed until 17379 ships * add same exprnamed lifting to udtf
…sed (#108) * fix: Prune partitions when no filters are defined * fix: Backport for DF49: * review: Address comments
* FileScanConfig: preserve schema metadata across serde boundary * add test
UPSTREAM NOTE: this should not be upstreamed. This contains conflict fixes from various cherry-picks and differences in v50.
peasee
changed the title
phillipleblanc
approved these changes
Oct 27, 2025
UPSTREAM NOTE: this should not be upstreamed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.