Skip to content

Conversation

anmolanmol1234
Copy link
Collaborator

No description provided.

Copy link
Collaborator

@saxenapranav saxenapranav left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hope we want to disable readAhead for the whole of parquet file inputStream lifecycle. looks good!

if (shouldReadFully()) {
lastReadBytes = readFileCompletely(b, currentOff, currentLen);
} else if (shouldReadLastBlock()) {
this.readAheadEnabled = false;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets add some comments here for future reference.

@anujmodi2021 anujmodi2021 changed the title disable readAhead for parquet [POC] disable readAhead for parquet Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants