Skip to content

[Enhancement]: Support faster point query && retrieve #39897

Open
@xiaofan-luan

Description

Is there an existing issue for this?

  • I have searched the existing issues

What would you like to be added?

Many features rely on faster point queries and retrieval, such as partial updates, returning specific output fields, and insert deduplication.

There might be couple of thing to optimize primary key query

  1. Profiling and fix the bottleneck, especially the layout of the multi field data
  2. Support global PK index to avoid check too much bloom filters and search on all segment workers
  3. Support Quotient Filter for each segment(As alternative of bloom filter), and merge Quotient Filter on delegator to
  4. Support zone maps(aka skip indexes)
  5. Use ART to store Primary key.
  6. ....

Why is this needed?

No response

Anything else?

No response

Metadata

Assignees

No one assigned

    Labels

    kind/enhancementIssues or changes related to enhancement

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions