HDFS-17843. FileSystem.createFile() fails with relative path.#8279
Open
balodesecurity wants to merge 1 commit intoapache:trunkfrom
Open
HDFS-17843. FileSystem.createFile() fails with relative path.#8279balodesecurity wants to merge 1 commit intoapache:trunkfrom
balodesecurity wants to merge 1 commit intoapache:trunkfrom
Conversation
In three create() overloads within DistributedFileSystem, the doCall() method was passing the original (possibly relative) path `f` to getPathName() instead of the resolved absolute path `p`. This caused an IllegalArgumentException when using relative paths with createFile() builder and create() with favored nodes, while fs.create() worked fine. Fix: pass `p` (the symlink-resolved, absolute path) to getPathName() in all three affected doCall() implementations. Added TestDistributedFileSystem#testCreateFileWithRelativePath to verify both createFile() builder and create() with favored nodes work correctly with relative paths. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
|
💔 -1 overall
This message was automatically generated. |
Author
|
The |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description of PR
JIRA: https://issues.apache.org/jira/browse/HDFS-17843
DistributedFileSystem.createFile()(builder pattern) andcreate()with favored nodes threwIllegalArgumentExceptionwhen passed a relative path, whilefs.create()worked correctly.Root Cause
In three
create()overloads, thedoCall(Path p)method passed the original outer variablef(potentially relative) togetPathName()instead of the resolved absolute pathpcomputed byfixRelativePart()+ symlink resolution:The three affected methods are:
create(Path, FsPermission, boolean, int, short, long, Progressable, InetSocketAddress[])— create with favored nodescreate(Path, FsPermission, EnumSet, int, short, long, Progressable, ChecksumOpt, InetSocketAddress[], String, String)— create with EC/storage policy (used bycreateFile()builder)createNonRecursive(Path, FsPermission, EnumSet, int, short, long, Progressable, ChecksumOpt, InetSocketAddress[], String, String)Testing
Added
TestDistributedFileSystem#testCreateFileWithRelativePathcovering bothcreateFile()builder andcreate()with favored nodes using relative paths. Also verified manually against a running single-node HDFS cluster.For code changes:
LICENSE,LICENSE-binary,NOTICE-binaryfiles?