Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rpc: ignore offline/unassigned regions during cache warmup #274

Merged
merged 1 commit into from
Oct 23, 2024

Conversation

dethi
Copy link
Collaborator

@dethi dethi commented Oct 22, 2024

When warming up the cache, ignore regions that are offline/unassigned. They could exist for many reasons:

  • parent region after a split, until daughter regions are compacted
  • regions that are merged together, until compaction happens
  • region moving due to HBase LoadBalancer, RegionServer shutting down or manually
  • etc

It's not critical if we are missing a few regions in the cache during warmup. The most important thing is for the warmup to be fast and to fill in with as many regions as possible. Other regions will be fetched later as needed.

rpc.go Outdated Show resolved Hide resolved
When warming up the cache, ignore regions that are offline/unassigned.
They could exist for many reasons:
- parent region after a split, until daughter regions are compacted
- regions that are merged together, until compaction happens
- region moving due to HBase LoadBalancer, RegionServer shutting down or
  manually
- etc

It's not critical if we are missing a few regions in the cache during
warmup. The most important thing is for the warmup to be fast and to
fill in with as many regions as possible. Other regions will be fetched
later as needed.
Copy link
Contributor

@gogochickenleg gogochickenleg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dethi dethi merged commit 71b8b24 into master Oct 23, 2024
2 checks passed
@dethi dethi deleted the fix-meta-warmup branch October 23, 2024 17:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants