You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Introduce a generic Array / ArrayView abstraction that encapsulates the in-memory format in arrow independently from any concrete arrow implementation.
Motivation
Having a small, common abstraction layer makes it simpler to
Support different constructors of arrow arrays (serde or manual builders)
Design
Implement an Array / ArrayView Enum with variants for all supported data types. The arrays should be "open" for direct modification to allow construction outside of serde_arrow. The information should be included without redudancy (e.g., no separate length field for the validity bitmap and the overall array).
Store any field metadata that cannot be reconstructed from the array separately (name, nullable, metadata).
Introduce a generic Array / ArrayView abstraction that encapsulates the in-memory format in arrow independently from any concrete arrow implementation.
Motivation
Having a small, common abstraction layer makes it simpler to
Design
Implement an
Array
/ArrayView
Enum with variants for all supported data types. The arrays should be "open" for direct modification to allow construction outside ofserde_arrow
. The information should be included without redudancy (e.g., no separate length field for the validity bitmap and the overall array).Store any field metadata that cannot be reconstructed from the array separately (name, nullable, metadata).
Steps
From<..> for ArrayDeserializer
implsdeserialization::construction
submoduleThe text was updated successfully, but these errors were encountered: