Skip to content

Arrays cannot hold concretely typed children #6293

@gatesn

Description

@gatesn

What happened?

At least FSSTArray, possibly others, hold concretely typed child arrays. In this case, FSST holds a VarBinArray for its codes.

This makes the with_children function error when swapping the child out for something that isn't a VarBinArray.

Unfortunately, we're a little stuck. We could split this up into offsets / data children, but that's a breaking change to the serde format. For now we may have to just convert the new child array back to VarBinArray, at whatever cost.

A fix would be to deprecate FSST, and implement a reduce function to replace itself with FSST2. But we should really work out how we to support GPU decoding before doing this.

Steps to reproduce

FSSTArray::with_children

Environment

Develop

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions