-
Notifications
You must be signed in to change notification settings - Fork 840
Open
Description
Is your feature request related to a problem? Please describe.
parquet-common library recently adds support for labels projection prometheus-community/parquet-common#118. This allows fetching only required columns when materializing and should greatly reduce data downloaded.
Describe the solution you'd like
To enable this feature, there are several steps required:
- Add thanos engine optimizer to enable projection pushdown optimization Add projection pushdown optimizer thanos-io/promql-engine#549
- Upgrade parquet-common and expose config to honor projection hints in Parquet queryable
- Since projection is not supported by Ingester, we may need to handle it properly in querier to only do projection pushdown when ingester is not queried.
Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.