Skip to content

HBASE-related dependencies upgrade #51

@ostinru

Description

@ostinru

In #42 I faced a dependency hell. Different components uses different versions of protobuf, hadoop-* and other libraries. It makes it almost impossible to update dependencies.

In my cases first thing to break were a HBASE tests. And It seems that we can solve this issue by updating HBASE plugin to use shaded versions of libraries: hbase-shaded-client. And its dependencies (e.g. hbase-shaded-protobuf). It is expected that it will use own namespace for dependencies (e.g. com.google.protobuf.ByteString -> org.apache.hadoop.hbase.shaded.com.google.protobuf.ByteString) and this should solve dependencies issues.

Overall:

  • build a PoC with shaded version of hbase-client
  • estimate PXF bundle size increase (and provide recomendations on how to build PXF without HBASE support)

Metadata

Metadata

Assignees

No one assigned

    Labels

    dependenciesPull requests that update a dependency file

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions