Skip to content

Handle ReadHints pushed down by prometheus remote read #17641

Open
@foobar

Description

Proposal:
Make use of pushed-down ReadHints to speed up prometheus remote read query

Current behavior:
InfluxDB 1.x has support for prometheus remote read/write, but historically to avoid dependency it copied protobuf definition(from #8784).
The remote-read pb message contains label matcher and time range and that is used to filter influxdb points. But the current prometheus version has added more fields to the pb message, including ReadHints. The read hints may be used by remote storage to do more filtering and return less data.
Also the new-added streamed response type can mitigate memory usage-for now it needs to hold the whole result set in memory.

Desired behavior:
InfluxDB may make use of the ReadHint and handles prometheus query locally.

Alternatives considered:
n/a

Use case:

For users who use InfluxDB as prometheus remote storage, the pushed-down hints will avoid large data transformation.

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions