Skip to content

Support Arrow reading nested types #1256

Closed as duplicate of#536
Closed as duplicate of#536
@Jolanrensen

Description

@Jolanrensen

Currently Arrow reading does not support nested types, such as for StructVector or
ListVector (which we don't support at all). We might need some recursive function, such as here for Maps in Spark to perform the type mapping, or at least let DataFrame infer the types like with a call to inferType().

I'm not sure whether Arrow allows for arbitrarily nested Lists.

But it seems like ListVector.field.children[].type is available ;)

For writing, see #271

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions