Skip to content

Optimize StringView row decoding #5945

@alamb

Description

@alamb

Is your feature request related to a problem or challenge? Please describe what you are trying to do.
Part of #5374

@XiangpengHao implemented row format --> ByteView (StringView / BinaryView) encoding/decoing in https://github.com/apache/arrow-rs/pull/5922/files

Describe the solution you'd like

  1. Add a benchmark for StringView to https://github.com/apache/arrow-rs/blob/master/arrow/benches/row_format.rs
  2. Make the row conversion faster

Describe alternatives you've considered
@tustvold noted that a potential performance improvement https://github.com/apache/arrow-rs/pull/5922/files#r1650032068 -- namely to build the array directly rather than build a StringArray and then convert to StringView

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    arrowChanges to the arrow crateenhancementAny new improvement worthy of a entry in the changelog

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions