Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: lexsort_to_indices unsupported mixed types with list #5455

Merged
merged 2 commits into from
Mar 2, 2024

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Mar 2, 2024

NOTE this is code that @JasonLi-cn wrote -- I simply made the PR and ticket so we can have a place to discuss.

Which issue does this PR close?

Closes #5454

Rationale for this change

Fix bug

Note that @JasonLi-cn reports that this approach is slower than using RowFormat as he did in apache/datafusion#9410

What changes are included in this PR?

Add support to lex_sort_to_indices for List type

Are there any user-facing changes?

Less bug

@github-actions github-actions bot added the arrow Changes to the arrow crate label Mar 2, 2024
@alamb alamb marked this pull request as ready for review March 2, 2024 12:00
@alamb alamb marked this pull request as draft March 2, 2024 12:03
@alamb alamb marked this pull request as ready for review March 2, 2024 15:48
Copy link
Contributor

@tustvold tustvold left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems sensible to me, the performance won't be fantastic but we already suggest people use the row format instead of LexicographicalComparator

@tustvold tustvold merged commit c5ab64c into apache:master Mar 2, 2024
22 checks passed
@alamb
Copy link
Contributor Author

alamb commented Mar 3, 2024

Thank you for the review @tustvold and the code @JasonLi-cn 🙏

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arrow Changes to the arrow crate
Projects
None yet
3 participants