Skip to content

Support labels projection for Parquet Queryable #7090

@yeya24

Description

@yeya24

Is your feature request related to a problem? Please describe.
parquet-common library recently adds support for labels projection prometheus-community/parquet-common#118. This allows fetching only required columns when materializing and should greatly reduce data downloaded.

Describe the solution you'd like
To enable this feature, there are several steps required:

  • Add thanos engine optimizer to enable projection pushdown optimization Add projection pushdown optimizer thanos-io/promql-engine#549
  • Upgrade parquet-common and expose config to honor projection hints in Parquet queryable
  • Since projection is not supported by Ingester, we may need to handle it properly in querier to only do projection pushdown when ingester is not queried.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions