Skip to content

Centralize common code for footer checksum read in BaseSearchableSnapshotIndexInput class #68902

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Feb 15, 2021

Conversation

tlrx
Copy link
Member

@tlrx tlrx commented Feb 11, 2021

This pull request factorizes in the BaseSearchableSnapshotIndexInput class some common code used to read the footer checksum of searchable snapshots IndexInput implementations.

This change helps to maintain the code to read the footer checksum in one place and helps to enable this optimisation for DirectBlobContainerIndexInput. It also helps to assert the non-usage of the cache fetch async thread pool when reading from a index input in a single place.

Finally, the index input unit tests have been adapted to account for the footer checksum read optimisation: they now generate a binary content that contains a valid footer checksum.

@elasticmachine elasticmachine added the Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. label Feb 11, 2021
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-distributed (Team:Distributed)

@tlrx tlrx changed the title Base checksum read Centralize common code for footer checksum read in BaseSearchableSnapshotIndexInput class Feb 11, 2021
@tlrx tlrx requested review from original-brownbear and ywelsch and removed request for original-brownbear February 11, 2021 13:58
Copy link
Contributor

@ywelsch ywelsch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Override
public final long length() {
return length;
}

protected final void readInternal(ByteBuffer b) throws IOException {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@Override

@tlrx tlrx merged commit 4c10c14 into elastic:master Feb 15, 2021
@tlrx tlrx deleted the base-checksum-read branch February 15, 2021 16:21
@tlrx
Copy link
Member Author

tlrx commented Feb 15, 2021

Thanks Yannick

tlrx added a commit to tlrx/elasticsearch that referenced this pull request Feb 16, 2021
…shotIndexInput class (elastic#68902)

This commit factorizes in the BaseSearchableSnapshotIndexInput
class some common code used to read the footer checksum of
searchable snapshots IndexInput implementations.

This change helps to maintain the code to read the footer checksum
in one place and helps to enable this optimisation for
DirectBlobContainerIndexInput. It also helps to assert the non-usage
of the cache fetch async thread pool when reading from a index input
in a single place.

Finally, the index input unit tests have been adapted to account for
the footer checksum read optimisation: they now generate a binary
content that contains a valid footer checksum.
@tlrx tlrx removed the v7.11.2 label Feb 16, 2021
tlrx added a commit that referenced this pull request Feb 16, 2021
…shotIndexInput class (#68902) (#69015)

This commit factorizes in the BaseSearchableSnapshotIndexInput
class some common code used to read the footer checksum of
searchable snapshots IndexInput implementations.

This change helps to maintain the code to read the footer checksum
in one place and helps to enable this optimisation for
DirectBlobContainerIndexInput. It also helps to assert the non-usage
of the cache fetch async thread pool when reading from a index input
in a single place.

Finally, the index input unit tests have been adapted to account for
the footer checksum read optimisation: they now generate a binary
content that contains a valid footer checksum.

Backport of #68902
@jakelandis jakelandis removed the v8.0.0 label Jul 26, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
:Distributed Coordination/Snapshot/Restore Anything directly related to the `_snapshot/*` APIs >enhancement Team:Distributed (Obsolete) Meta label for distributed team (obsolete). Replaced by Distributed Indexing/Coordination. v7.12.0 v8.0.0-alpha1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants