[Feature] Add Optional Time Range in `manifest.json` for Secondary Index

[hanahmily]

Search before asking

• I had searched in the issues and found no similar feature requirement.

Description

We need to enhance the manifest.json file of the secondary index by introducing two optional fields for time range, specifically max_timestamp and min_timestamp.

• The new fields are optional because, in some cases, the key itself might be the timestamp, which means that the max/min keys will also correspond to the max/min timestamps.
• They are used to improve the part selection algorithm.

Use case

No response

Related issues

No response

Are you willing to submit a pull request to implement this on your own?

• Yes I am willing to submit a pull request on my own!

Code of Conduct

• I agree to follow this project's Code of Conduct