Skip to content

Remove translog retention policy #51417

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jan 24, 2020

Conversation

dnhatn
Copy link
Member

@dnhatn dnhatn commented Jan 24, 2020

We no longer need to retain the extra translog for peer recovery as we have switched using Lucene index exclusively in 8.0. This change removes the translog retention policy.

I think we can also remove the async trim translog task. I will do it in a separate PR.

Relates #50775

@dnhatn dnhatn added >enhancement :Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. v8.0.0 labels Jan 24, 2020
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (:Distributed/Engine)

@dnhatn dnhatn mentioned this pull request Jan 24, 2020
14 tasks
Copy link
Contributor

@ywelsch ywelsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great PR stats. I've left some minor comments.

@dnhatn dnhatn requested a review from ywelsch January 24, 2020 17:26
Copy link
Contributor

@ywelsch ywelsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dnhatn
Copy link
Member Author

dnhatn commented Jan 24, 2020

run elasticsearch-ci/2

@dnhatn
Copy link
Member Author

dnhatn commented Jan 24, 2020

Thanks Yannick.

@dnhatn dnhatn merged commit b034d1e into elastic:master Jan 24, 2020
@dnhatn dnhatn deleted the remove-translog-deletion-policy branch January 24, 2020 20:14
dnhatn added a commit that referenced this pull request Jan 31, 2020
Before #51417, trimUnreferencedReaders in this test was a noop as the 
default translog retention policy was 512MB and 12h, which was long 
enough to keep all translog files. Two problems in this test:

- We do not consider any failure while trimming unreferenced readers as 
  a tragedy.

- We should clear the synced list before calling 
  trimUnreferencedReaders.

Relates #51505
Closes #51694
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Indexing/Engine Anything around managing Lucene and the Translog in an open shard. >enhancement v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants