HADOOP-9991. Update netty to 3.7.1.Final to sync with zookeper #85
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
depends on zookeeper 3.4.6 which depends on netty 3.7.x. Related to apache#84
ceefour
changed the title
|
branch-2.7 is now effectively EoL. Closing this. |
shanthoosh
added a commit
to shanthoosh/hadoop
that referenced
this pull request
Oct 15, 2019
Adds non blocking commit into AsyncRunLoop. Clients can enable it by setting an opt-in config task.async.commit (which is disabled by default). Contains the following list of changes for AsyncStreamTask type of tasks. a) Enable commit for a task, when there're uncompleted callbacks from a task. Progressive commit of finished callbacks, when there are messages in flight for a task. b) Enable processing of messages for a task, when there're commits in progress from a task. Documentation for this change will be done in a separate PR. Author: Shanthoosh Venkataraman <svenkataraman@linkedin.com> Reviewers: Yi Pan <nickpan47@gmail.com> Closes apache#85 from shanthoosh/asyncCommitSupport
saxenapranav
added a commit
to saxenapranav/hadoop
that referenced
this pull request
Jul 28, 2023
…timization Rename resume optimizations: Changes include: 1. Resume the rename only if srcDirectory is present and it's etag matches to the one that was there at the time of rename. Else, just delete the pendingJson. 2. PendingJson will now have Etag information of the srcDir at the time of rename. 3. There is listStatus done after its found that renamePendingJson is there. But since there can be scenario where rename resume shouldnt be done (like srcDir not there, or original srcDir is changed(etag change)), the second listStatus shall be redundant. In case of not requirement, it will not be called. 4. For the resume, fileStatus is already there with listStatus or getFileStatus for renamePendingJson file. On ABFS_3,3.2_dev, for reading the file, we have to open which needs getFileStatus. This is a redundant call and needs optimization. This optimization is taken. For this backported HADOOP-17682. ABFS: Support FileStatus input to OpenFileWithOptions() via OpenFileParameters apache#2975 at commit: dcddc6a
4 tasks
This was referenced Sep 11, 2023
This was referenced Oct 4, 2023
4 tasks
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Update netty to 3.7.1.Final because hadoop-client 2.7.2 depends on zookeeper 3.4.6 which depends on netty 3.7.x. Related to #84