Open
Description
Is your feature request related to a problem or challenge?
Tracking ticket for next release, also a place to track desired inclusions
Previous release will be https://crates.io/crates/datafusion/47.0.0 (April, 2025) so next major release would be late May or Early June 2025
Steps:
- Update version and changelog:
- Test with DataFusion Python:
- Test with DataFusion Comet
- Test with delta.rs:
- Test with SailHQ:
- Write upgrade guide:
- Test with parquet viewer
- Test with datafusion-materialized-views
- Voting Thread:
- Create ticket for next release:
Prior release tickets:
Changes to add to upgrade guide
These PRs made changes that deserve a mention in the upgrade guide
Features to mention in the blog (if they make it)
- feat: Add
datafusion-spark
crate #15168 - feat: ORDER BY ALL #15772
- [EPIC] A collection of tickets for improving sorting larger than memory datasets / spilling sorts #15271
- Change mapping of SQL
VARCHAR
fromUtf8
toUtf8View
#15096
Bugs that would be good to fix
- Fix: after repartitioning, the
PartitionedFile
andFileGroup
statistics should be inexact/recomputed #15539 - Fix: fetch is missing in
replace_order_preserving_variants
method duringEnforceDistribution
optimizer #15808