Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize the prefix performance of RocksDB iterator after delete range #5525

Merged
merged 7 commits into from
May 18, 2023

Conversation

luyade
Copy link
Contributor

@luyade luyade commented Apr 23, 2023

What type of PR is this?

  • bug
  • feature
  • enhancement

What problem(s) does this PR solve?

Issue(s) number:

#5524

Description:

How do you solve it?

Special notes for your reviewer, ex. impact of this fix, design document, etc:

Checklist:

Tests:

  • Unit test(positive and negative cases)
  • Function test
  • Performance test
  • N/A

Affects:

  • Documentation affected (Please add the label if documentation needs to be modified.)
  • Incompatibility (If it breaks the compatibility, please describe it and add the label.)
  • If it's needed to cherry-pick (If cherry-pick to some branches is required, please label the destination version(s).)
  • Performance impacted: Consumes more CPU/Memory

Release notes:

Please confirm whether to be reflected in release notes and how to describe:

ex. Fixed the bug .....

@Sophie-Xie Sophie-Xie added the ready-for-testing PR: ready for the CI test label Apr 23, 2023
@wey-gu wey-gu requested a review from critical27 April 24, 2023 01:18
src/kvstore/RocksEngine.h Outdated Show resolved Hide resolved
Copy link
Contributor

@wenhaocs wenhaocs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job. Thanks for the contribution.

rocksdb::Slice prefix_;
// temporary key to make sure data_ of iterateUpperBound_ valid during its lifetime
std::string iterateUpperBoundKey_;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since it's temporary, I prefer keeping its lifetime temp as well, that is, not setting as protected/private variable.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

iterateUpperBoundKey_ is not really temporary. This string should be valid during the whole lifetime of this iterator. Otherwise, if the string got destroyed before iterator, the iterate_upper_bound of rocksdb::ReadOptions will become invalid, which will then result in crash.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

then the field iterateUpperBound_ is no needed, you could construct rocksdb::Slice from upperBoundKey_ every time when needed. Since rocksdb::Slice is an string view, and really lightweight.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated. We passed a pointer to ReadOptions and we should make sure the pointer valid before the iterator is destructed, so the Slice also should not be a local temporary variable.

src/kvstore/RocksEngine.h Outdated Show resolved Hide resolved
Copy link
Contributor

@pengweisong pengweisong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job, thanks for contribution.

src/kvstore/RocksEngine.h Outdated Show resolved Hide resolved
src/kvstore/RocksEngine.h Outdated Show resolved Hide resolved
src/kvstore/RocksEngine.h Outdated Show resolved Hide resolved
rocksdb::Slice prefix_;
// temporary key to make sure data_ of iterateUpperBound_ valid during its lifetime
std::string iterateUpperBoundKey_;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

then the field iterateUpperBound_ is no needed, you could construct rocksdb::Slice from upperBoundKey_ every time when needed. Since rocksdb::Slice is an string view, and really lightweight.

Copy link
Contributor

@pengweisong pengweisong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good job

@Sophie-Xie Sophie-Xie merged commit 4707b71 into vesoft-inc:master May 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ready-for-testing PR: ready for the CI test
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants