Skip to content

HDDS-1600. Add userName and IPAddress as part of OMRequest. #857

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jun 4, 2019

Conversation

bharatviswa504
Copy link
Contributor

@bharatviswa504 bharatviswa504 commented May 27, 2019

In OM HA, the actual execution of request happens under GRPC context, so UGI object which we retrieve from ProtobufRpcEngine.Server.getRemoteUser(); will not be available.

In similar manner ProtobufRpcEngine.Server.getRemoteIp().

So, during preExecute(which happens under RPC context) extract userName and IPAddress and add it to the OMRequest, and then send the request to ratis server.

@bharatviswa504 bharatviswa504 self-assigned this May 27, 2019
@bharatviswa504 bharatviswa504 force-pushed the HDDS-1600 branch 2 times, most recently from b4a0740 to 1d18242 Compare May 27, 2019 23:23
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 1613 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 16 new or modified test files.
_ trunk Compile Tests _
0 mvndep 74 Maven dependency ordering for branch
+1 mvninstall 565 trunk passed
+1 compile 274 trunk passed
+1 checkstyle 73 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 872 branch has no errors when building and testing our client artifacts.
+1 javadoc 146 trunk passed
0 spotbugs 304 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 491 trunk passed
_ Patch Compile Tests _
0 mvndep 32 Maven dependency ordering for patch
+1 mvninstall 509 the patch passed
+1 compile 278 the patch passed
+1 cc 278 the patch passed
+1 javac 278 the patch passed
-0 checkstyle 41 hadoop-hdds: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-0 checkstyle 44 hadoop-ozone: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 3 The patch has no ill-formed XML file.
+1 shadedclient 682 patch has no errors when building and testing our client artifacts.
-1 javadoc 73 hadoop-ozone generated 6 new + 5 unchanged - 0 fixed = 11 total (was 5)
+1 findbugs 514 the patch passed
_ Other Tests _
-1 unit 200 hadoop-hdds in the patch failed.
-1 unit 52 hadoop-ozone in the patch failed.
-1 asflicense 38 The patch generated 17 ASF License warnings.
13655
Reason Tests
Failed junit tests hadoop.ozone.om.exceptions.TestResultCodes
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux 072b779556db 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / ec92ca6
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/diff-checkstyle-hadoop-hdds.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 412 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/1/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 37 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 16 new or modified test files.
_ trunk Compile Tests _
0 mvndep 65 Maven dependency ordering for branch
+1 mvninstall 527 trunk passed
+1 compile 266 trunk passed
+1 checkstyle 78 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 932 branch has no errors when building and testing our client artifacts.
+1 javadoc 149 trunk passed
0 spotbugs 325 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 531 trunk passed
_ Patch Compile Tests _
0 mvndep 31 Maven dependency ordering for patch
+1 mvninstall 505 the patch passed
+1 compile 286 the patch passed
+1 cc 286 the patch passed
+1 javac 286 the patch passed
-0 checkstyle 42 hadoop-hdds: The patch generated 2 new + 0 unchanged - 0 fixed = 2 total (was 0)
-0 checkstyle 38 hadoop-ozone: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 3 The patch has no ill-formed XML file.
+1 shadedclient 717 patch has no errors when building and testing our client artifacts.
-1 javadoc 78 hadoop-ozone generated 6 new + 5 unchanged - 0 fixed = 11 total (was 5)
+1 findbugs 535 the patch passed
_ Other Tests _
-1 unit 167 hadoop-hdds in the patch failed.
-1 unit 51 hadoop-ozone in the patch failed.
-1 asflicense 44 The patch generated 17 ASF License warnings.
12976
Reason Tests
Failed junit tests hadoop.ozone.om.exceptions.TestResultCodes
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml findbugs checkstyle cc
uname Linux e214af0213dd 4.4.0-139-generic #165~14.04.1-Ubuntu SMP Wed Oct 31 10:55:11 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / b70d1be
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/diff-checkstyle-hadoop-hdds.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 356 (vs. ulimit of 5500)
modules C: hadoop-hdds/common hadoop-ozone/common hadoop-ozone/integration-test hadoop-ozone/ozone-manager U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/3/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 31 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
0 mvndep 38 Maven dependency ordering for branch
+1 mvninstall 551 trunk passed
+1 compile 275 trunk passed
+1 checkstyle 75 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 828 branch has no errors when building and testing our client artifacts.
+1 javadoc 149 trunk passed
0 spotbugs 303 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 492 trunk passed
_ Patch Compile Tests _
0 mvndep 17 Maven dependency ordering for patch
+1 mvninstall 495 the patch passed
+1 compile 260 the patch passed
+1 cc 260 the patch passed
+1 javac 260 the patch passed
+1 checkstyle 69 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 649 patch has no errors when building and testing our client artifacts.
-1 javadoc 73 hadoop-ozone generated 2 new + 8 unchanged - 0 fixed = 10 total (was 8)
+1 findbugs 496 the patch passed
_ Other Tests _
-1 unit 229 hadoop-hdds in the patch failed.
-1 unit 1273 hadoop-ozone in the patch failed.
+1 asflicense 44 The patch does not generate ASF License warnings.
6307
Reason Tests
Failed junit tests hadoop.hdds.scm.block.TestBlockManager
hadoop.ozone.container.TestContainerReplication
hadoop.ozone.om.TestOmAcls
hadoop.ozone.client.rpc.TestWatchForCommit
hadoop.ozone.client.rpc.TestOzoneRpcClient
hadoop.ozone.client.rpc.TestSecureOzoneRpcClient
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc xml
uname Linux 1527891eb542 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 219e286
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/testReport/
Max. process+thread count 5238 (vs. ulimit of 5500)
modules C: hadoop-ozone/common hadoop-ozone/ozone-manager hadoop-ozone/integration-test U: hadoop-ozone
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/5/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 42 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
0 mvndep 44 Maven dependency ordering for branch
+1 mvninstall 573 trunk passed
+1 compile 273 trunk passed
+1 checkstyle 77 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 926 branch has no errors when building and testing our client artifacts.
+1 javadoc 159 trunk passed
0 spotbugs 348 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 577 trunk passed
_ Patch Compile Tests _
0 mvndep 21 Maven dependency ordering for patch
+1 mvninstall 523 the patch passed
+1 compile 290 the patch passed
+1 cc 290 the patch passed
+1 javac 290 the patch passed
+1 checkstyle 84 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 1 The patch has no whitespace issues.
+1 xml 1 The patch has no ill-formed XML file.
+1 shadedclient 720 patch has no errors when building and testing our client artifacts.
-1 javadoc 80 hadoop-ozone generated 2 new + 8 unchanged - 0 fixed = 10 total (was 8)
+1 findbugs 531 the patch passed
_ Other Tests _
+1 unit 269 hadoop-hdds in the patch passed.
-1 unit 1313 hadoop-ozone in the patch failed.
+1 asflicense 98 The patch does not generate ASF License warnings.
6872
Reason Tests
Failed junit tests hadoop.ozone.om.TestOmAcls
hadoop.ozone.om.TestOzoneManagerHA
hadoop.ozone.client.rpc.TestCommitWatcher
hadoop.ozone.client.rpc.TestOzoneRpcClientWithRatis
hadoop.ozone.client.rpc.TestBCSID
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/4/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc xml
uname Linux 2aad089df69e 4.4.0-144-generic #170~14.04.1-Ubuntu SMP Mon Mar 18 15:02:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 219e286
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/4/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/4/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/4/testReport/
Max. process+thread count 5296 (vs. ulimit of 5500)
modules C: hadoop-ozone/common hadoop-ozone/ozone-manager hadoop-ozone/integration-test U: hadoop-ozone
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/4/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504 bharatviswa504 requested a review from xiaoyuyao May 31, 2019 18:41
throw new OzoneAclException("User " + user.getUserName() + " doesn't " +
"have " + acl + " permission to access " + resType,
ErrorCode.PERMISSION_DENIED);
user.getUserName(), aclType, resType);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The unit test failure seems related:
TestOmAcls.testOMAclsPermissionDenied
org.apache.hadoop.ozone.om.exceptions.OMException: User jenkins1000 doesn't have CREATE permission to access volume

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes @xiaoyuyao. Will address in the next patch along with review comments.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

volumeName, bucketName, null);
}

metadataManager.getLock().acquireVolumeLock(volumeName);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the right lock pattern is to acquire lock out of try {} block and release them in the final block.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

}

// acquire lock
omMetadataManager.getLock().acquireBucketLock(volumeName, bucketName);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same as above.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed.

Copy link
Contributor

@xiaoyuyao xiaoyuyao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @bharatviswa504 for working on this. Patch LGTM overall. A few minor comments inline.

@ajayydv
Copy link
Contributor

ajayydv commented Jun 3, 2019

@bharatviswa504 thanks for the patch. On a second thought i wonder why don't we complete authorization on the OM which receives the first request from client, this will save us the trouble of propagating credentials in rest of the call and simplify HA design.

@bharatviswa504
Copy link
Contributor Author

bharatviswa504 commented Jun 3, 2019

@bharatviswa504 thanks for the patch. On a second thought i wonder why don't we complete authorization on the OM which receives the first request from client, this will save us the trouble of propagating credentials in rest of the call and simplify HA design.

We cannot do checkAcls on any OM(which some times might not be leader), because think of a case like setAcl's is not applied on that OM(as it is a follower) but we are performing check Acl's.

Discussed offline with @xiaoyuyao and @ajayydv, we cannot take this approach as OM followers can lag leader OM, so it might not have latest changes, if we do check on Non-leader OM, we might see some inconsistent behavior.

@bharatviswa504
Copy link
Contributor Author

Hi @xiaoyuyao
Thanks for the review.
I have addressed the review comments.

@xiaoyuyao
Copy link
Contributor

LGTM, thanks for the update. +1, pending CI.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 31 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
0 mvndep 59 Maven dependency ordering for branch
+1 mvninstall 584 trunk passed
+1 compile 309 trunk passed
+1 checkstyle 92 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 907 branch has no errors when building and testing our client artifacts.
+1 javadoc 179 trunk passed
0 spotbugs 334 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 524 trunk passed
_ Patch Compile Tests _
0 mvndep 26 Maven dependency ordering for patch
+1 mvninstall 489 the patch passed
+1 compile 290 the patch passed
+1 cc 290 the patch passed
+1 javac 290 the patch passed
-0 checkstyle 51 hadoop-ozone: The patch generated 4 new + 0 unchanged - 0 fixed = 4 total (was 0)
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 632 patch has no errors when building and testing our client artifacts.
-1 javadoc 91 hadoop-ozone generated 1 new + 8 unchanged - 0 fixed = 9 total (was 8)
+1 findbugs 536 the patch passed
_ Other Tests _
-1 unit 224 hadoop-hdds in the patch failed.
-1 unit 1130 hadoop-ozone in the patch failed.
+1 asflicense 47 The patch does not generate ASF License warnings.
6490
Reason Tests
Failed junit tests hadoop.hdds.scm.container.TestReplicationManager
hadoop.ozone.om.TestOzoneManagerConfiguration
hadoop.ozone.client.rpc.TestFailureHandlingByClient
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc xml
uname Linux 8faf0e576bff 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 277e9a8
Default Java 1.8.0_212
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/artifact/out/diff-checkstyle-hadoop-ozone.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/artifact/out/patch-unit-hadoop-hdds.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/testReport/
Max. process+thread count 4874 (vs. ulimit of 5500)
modules C: hadoop-ozone/common hadoop-ozone/ozone-manager hadoop-ozone/integration-test U: hadoop-ozone
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/6/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504
Copy link
Contributor Author

/retest

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 31 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
0 mvndep 14 Maven dependency ordering for branch
+1 mvninstall 552 trunk passed
+1 compile 307 trunk passed
+1 checkstyle 89 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 871 branch has no errors when building and testing our client artifacts.
+1 javadoc 182 trunk passed
0 spotbugs 344 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 532 trunk passed
_ Patch Compile Tests _
0 mvndep 26 Maven dependency ordering for patch
+1 mvninstall 560 the patch passed
+1 compile 294 the patch passed
+1 cc 294 the patch passed
+1 javac 294 the patch passed
+1 checkstyle 96 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 649 patch has no errors when building and testing our client artifacts.
-1 javadoc 93 hadoop-ozone generated 1 new + 8 unchanged - 0 fixed = 9 total (was 8)
+1 findbugs 536 the patch passed
_ Other Tests _
+1 unit 212 hadoop-hdds in the patch passed.
-1 unit 1152 hadoop-ozone in the patch failed.
+1 asflicense 61 The patch does not generate ASF License warnings.
6515
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/7/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc xml
uname Linux 47ab0e7f8513 4.4.0-138-generic #164-Ubuntu SMP Tue Oct 2 17:16:02 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 606061a
Default Java 1.8.0_212
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-857/7/artifact/out/diff-javadoc-javadoc-hadoop-ozone.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/7/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/7/testReport/
Max. process+thread count 4715 (vs. ulimit of 5500)
modules C: hadoop-ozone/common hadoop-ozone/ozone-manager hadoop-ozone/integration-test U: hadoop-ozone
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/7/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 45 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 6 new or modified test files.
_ trunk Compile Tests _
0 mvndep 44 Maven dependency ordering for branch
+1 mvninstall 582 trunk passed
+1 compile 293 trunk passed
+1 checkstyle 82 trunk passed
+1 mvnsite 0 trunk passed
+1 shadedclient 943 branch has no errors when building and testing our client artifacts.
+1 javadoc 171 trunk passed
0 spotbugs 343 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 547 trunk passed
_ Patch Compile Tests _
0 mvndep 22 Maven dependency ordering for patch
+1 mvninstall 510 the patch passed
+1 compile 311 the patch passed
+1 cc 311 the patch passed
+1 javac 311 the patch passed
+1 checkstyle 87 the patch passed
+1 mvnsite 0 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 xml 2 The patch has no ill-formed XML file.
+1 shadedclient 725 patch has no errors when building and testing our client artifacts.
+1 javadoc 169 the patch passed
+1 findbugs 553 the patch passed
_ Other Tests _
+1 unit 272 hadoop-hdds in the patch passed.
-1 unit 2692 hadoop-ozone in the patch failed.
+1 asflicense 74 The patch does not generate ASF License warnings.
8316
Reason Tests
Failed junit tests hadoop.ozone.client.rpc.TestBlockOutputStream
hadoop.ozone.TestMiniChaosOzoneCluster
hadoop.ozone.client.rpc.TestBCSID
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/hadoop-multibranch/job/PR-857/8/artifact/out/Dockerfile
GITHUB PR #857
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle cc xml
uname Linux c2b996687d72 4.4.0-144-generic #170~14.04.1-Ubuntu SMP Mon Mar 18 15:02:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 606061a
Default Java 1.8.0_212
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-857/8/artifact/out/patch-unit-hadoop-ozone.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-857/8/testReport/
Max. process+thread count 4756 (vs. ulimit of 5500)
modules C: hadoop-ozone/common hadoop-ozone/ozone-manager hadoop-ozone/integration-test U: hadoop-ozone
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-857/8/console
versions git=2.7.4 maven=3.3.9 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@bharatviswa504 bharatviswa504 requested a review from xiaoyuyao June 4, 2019 16:01
@bharatviswa504
Copy link
Contributor Author

Checkstyle issues and test failures are not related to this patch.
Thank You @xiaoyuyao for the review.
I will commit this to trunk.

@bharatviswa504 bharatviswa504 merged commit 580b639 into apache:trunk Jun 4, 2019
shanthoosh pushed a commit to shanthoosh/hadoop that referenced this pull request Oct 15, 2019
Author: Hai Lu <halu@linkedin.com>

Reviewers: Xinyu Liu <xiliu@linkedin.com>

Closes apache#857 from lhaiesp/master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants