Skip to content

Exporting struct array to arrow respects vortex nullabilty#6365

Merged
robert3005 merged 2 commits intodevelopfrom
rk/nullability
Feb 9, 2026
Merged

Exporting struct array to arrow respects vortex nullabilty#6365
robert3005 merged 2 commits intodevelopfrom
rk/nullability

Conversation

@robert3005
Copy link
Contributor

@robert3005 robert3005 commented Feb 9, 2026

fix #6326

Signed-off-by: Robert Kruszewski github@robertk.io

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the changelog/fix A bug fix label Feb 9, 2026
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 enabled auto-merge (squash) February 9, 2026 13:49
// Update current_array to the result for chaining
current_array = expected_result.clone();
(
Action::Mask(Mask::from_iter(mask)),
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

keep these as seperate they share cached state

Comment on lines +118 to +124
let mask_true_count = mask.true_count();
if mask_true_count == 0 {
// Fast-path for empty mask
return Ok(cast(array, &array.dtype().as_nullable())?.into());
}

if matches!(mask, Mask::AllTrue(_)) {
if mask_true_count == mask.len() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a east and common mistake to make are you sure it exists?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why was this necessary?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the nice thing about the old version was that it avoided scanning the indices for the fast paths

Copy link
Contributor

@joseph-isaacs joseph-isaacs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

which one is the actual fix? can we have a test?

@robert3005 robert3005 merged commit 5a7bd19 into develop Feb 9, 2026
56 of 57 checks passed
@robert3005 robert3005 deleted the rk/nullability branch February 9, 2026 15:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fuzzing Crash: MaskedArray execution produces dtype mismatch

3 participants