Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

store/tikv/gc_worker: Create new backoffer for each region #6438

Merged

Conversation

MyonKeminta
Copy link
Contributor

A GC job consists of 3 steps: resolving locks, deleting ranges, and doing GC. Previously, the first two steps use only one backoffer each, with the limit equals to 10,0000, regardless how large the task is. As a result, the larger the DB or the delete range tasks is, the more likely the GC job runs into a failure, which may cause more troubling problems.

To reduce the possibility that GC jobs fail, I create a new backoffer for each region when resolving lock and deleting ranges.

@MyonKeminta
Copy link
Contributor Author

@zhangjinpeng1987 PTAL

zhangjinpeng87
zhangjinpeng87 previously approved these changes May 2, 2018
Copy link
Contributor

@zhangjinpeng87 zhangjinpeng87 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@AndreMouche
Copy link
Contributor

/run-all-tests

@jackysp
Copy link
Member

jackysp commented May 3, 2018

CI failed, please fix it @MyonKeminta .

@MyonKeminta
Copy link
Contributor Author

Seems it's not what I can fix.. please re-run the test..

@winoros
Copy link
Member

winoros commented May 3, 2018

/run-sqllogic-test
/run-mybatis-test

@zimulala zimulala added status/LGT1 Indicates that a PR has LGTM 1. all-tests-passed labels May 9, 2018
@zhangjinpeng87
Copy link
Contributor

@coocood @tiancaiamao PTAL

@jackysp
Copy link
Member

jackysp commented May 24, 2018

Please resolve the conflicts @MyonKeminta .

cleanupMaxBackoff = 20000
GcOneRegionMaxBackoff = 20000
GcResolveLockMaxBackoff = 100000
DeleteRangeOneRegionMaxBackoff = 100000
Copy link
Contributor

@tiancaiamao tiancaiamao May 24, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's not used outside this package? Then you should use lower case variable.

@tiancaiamao
Copy link
Contributor

LGTM

@tiancaiamao tiancaiamao added the status/LGT2 Indicates that a PR has LGTM 2. label May 24, 2018
@coocood coocood removed the status/LGT1 Indicates that a PR has LGTM 1. label May 24, 2018
@coocood coocood merged commit 21135fa into pingcap:master May 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
status/LGT2 Indicates that a PR has LGTM 2.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants