Tracking Issues: support t-digest data structure and commands

[LindaSummer]

Search before asking

• I had searched in the issues and found no similar issues.

Motivation

Redis Stack already supports this probabilistic data structure, and we can support it too.

• Support t-digest data structure and commands #2423

This includes:

• feat(tdigest): add tdigest algorithm and storage encoding implementations #2741
• TDigest: use rocksdb iterator for centroids iteration. #2789
• TDigest: Implement CREATE and INFO command for TDigest Algorithm #2791
• TDigest: Implement ADD command for TDigest Algorithm #2792
• TDigest: Implement MIN MAX command for TDigest Algorithm #2793
• TDigest: Implement QUANTILE command for TDigest Algorithm #2794
• TDigest: Implement TDIGEST.RESET command Algorithm #2804
• TDigest: Implement TDIGEST.MERGE command #2805
• TDigest: Implement TDIGEST.CDF command #2807
• TDigest: Implement TDIGEST.RANK command #3062
• TDigest: Implement TDIGEST.REVRANK command #3063
• TDigest: Implement TDIGEST.BYRANK command #3064
• TDigest: Implement TDIGEST.BYREVRANK command #3065
• TDigest: Implement TDIGEST.TRIMMED_MEAN command #3066
• TDigest: Add documentation of encoding design to website #2813

Solution

• T-Digest Design Proposal #2542

Are you willing to submit a PR?

• I'm willing to submit a PR!

[LindaSummer]

Hi @PragmaTwice ,

Sorry for delay.

This issue's implementation is still in progress. 😊

I will try my best to implement and test the first fundamental commands in one month.

Best Regards,
Edward

[LindaSummer]

Hi @PragmaTwice ,

Sorry that I may need some more time to finish the first PR of t-digest feature.

Major part of create, add and quantile are nearly finished and I'm now trying to do self-testing and add unit tests. 😊

Here is my draft PR LindaSummer#1 in my own repo.
I'll try my best to add more tests and make it ready to be reviewed. 😊

Best Regards,
Edward

[yunxiao3]

Hello @LindaSummer, I am very interested in your project, and it seems that there is a lot of development tasks that need to be done. If possible, could you assign me some sub-tasks or areas where I can help? I’d like to contribute to the growth of the kvrocks community.

[LindaSummer]

Hello @LindaSummer, I am very interested in your project, and it seems that there is a lot of development tasks that need to be done. If possible, could you assign me some sub-tasks or areas where I can help? I’d like to contribute to the growth of the kvrocks community.

Hi @yunxiao3 ,

Thanks for your interests in this topic! 😊

You can try to pick up one command in current issue list or create a new issue for implementation. 😊

I will implement this #2791 command first in recent days.
You can follow it for other commands.

Before TDIGEST.CRETAE and TDIGEST.INFO commands finished, you can take STREAM command #745 implementation as example.

Best Regards,
Edward

[wyxxxcat]

Hello, I am new to this community and I want to try some simple questions to help me get familiar with the project. Can you assign MIN MAX to me? @LindaSummer

[LindaSummer]

Hello, I am new to this community and I want to try some simple questions to help me get familiar with the project. Can you assign MIN MAX to me? @LindaSummer

Hi @wyxxxcat ,

Thanks very much for your interest in kvrocks! 😄

You can just leave a comment under the issue you're interested in.

Best Regards,
Edward