Skip to content

HDFS-15463. Add a tool to validate FsImage. #2140

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 8 commits into from
Jul 20, 2020
Merged

HDFS-15463. Add a tool to validate FsImage. #2140

merged 8 commits into from
Jul 20, 2020

Conversation

szetszwo
Copy link
Contributor

@szetszwo szetszwo commented Jul 15, 2020 •
edited
Loading

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 22m 21s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 19m 59s trunk passed
+1 💚 compile 1m 23s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 19s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 57s trunk passed
+1 💚 mvnsite 1m 21s trunk passed
+1 💚 shadedclient 14m 54s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 38s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 52s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 2m 59s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 2m 57s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 21s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
-1 ❌ javac 1m 21s hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 generated 3 new + 598 unchanged - 0 fixed = 601 total (was 598)
+1 💚 compile 1m 12s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
-1 ❌ javac 1m 12s hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_252-8u252-b09-118.04-b09 with JDK Private Build-1.8.0_252-8u252-b09-118.04-b09 generated 3 new + 582 unchanged - 0 fixed = 585 total (was 582)
-0 ⚠️ checkstyle 0m 51s hadoop-hdfs-project/hadoop-hdfs: The patch generated 13 new + 49 unchanged - 1 fixed = 62 total (was 50)
+1 💚 mvnsite 1m 13s the patch passed
+1 💚 shellcheck 0m 33s There were no new shellcheck issues.
+1 💚 shelldocs 0m 16s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 16m 3s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 36s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 45s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 20s the patch passed
_ Other Tests _
-1 ❌ unit 116m 32s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
215m 39s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.snapshot.TestRenameWithSnapshots
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.server.blockmanagement.TestSequentialBlockGroupId
hadoop.hdfs.TestDFSStripedOutputStream
hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.TestStripedFileAppend
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA
hadoop.hdfs.server.blockmanagement.TestBlockInfoStriped
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 0b57b587ce60 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 80046d1
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/diff-compile-javac-hadoop-hdfs-project_hadoop-hdfs-jdkPrivateBuild-1.8.0_252-8u252-b09-1~18.04-b09.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/testReport/
Max. process+thread count 3980 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/1/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@szetszwo szetszwo requested a review from bshashikant July 15, 2020 15:59
@bshashikant
Copy link
Contributor

@szetszwo , TestRenameWithSnapshots test case is failing and is related. Can you plz check it as well as other javac and checkstyle checkstyle issues??

@szetszwo
Copy link
Contributor Author

Thanks @bshashikant . I just have updated the pull request to fix the test failure and the warnings.

@szetszwo szetszwo force-pushed the trunk branch 3 times, most recently from 181e80d to 35b53dc Compare July 15, 2020 17:56
@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 36s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 20m 33s trunk passed
+1 💚 compile 1m 21s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 13s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 49s trunk passed
+1 💚 mvnsite 1m 18s trunk passed
+1 💚 shadedclient 14m 10s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 37s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 46s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 2m 55s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 2m 53s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 9s the patch passed
+1 💚 compile 1m 9s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 9s the patch passed
+1 💚 compile 1m 4s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 4s the patch passed
-0 ⚠️ checkstyle 0m 43s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 49 unchanged - 1 fixed = 52 total (was 50)
+1 💚 mvnsite 1m 10s the patch passed
+1 💚 shellcheck 0m 30s There were no new shellcheck issues.
+1 💚 shelldocs 0m 15s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 13m 53s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 36s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 43s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 5s the patch passed
_ Other Tests _
-1 ❌ unit 99m 38s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
173m 18s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor
hadoop.hdfs.TestDFSInotifyEventInputStreamKerberized
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 9cfc823d64c5 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1f71c4a
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/testReport/
Max. process+thread count 4096 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/2/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 22m 0s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 19m 14s trunk passed
+1 💚 compile 1m 29s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 15s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 52s trunk passed
+1 💚 mvnsite 1m 23s trunk passed
+1 💚 shadedclient 14m 52s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 38s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 48s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 17s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 3m 14s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 15s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 18s the patch passed
+1 💚 compile 1m 3s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 3s the patch passed
-0 ⚠️ checkstyle 0m 43s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 49 unchanged - 1 fixed = 52 total (was 50)
+1 💚 mvnsite 1m 15s the patch passed
+1 💚 shellcheck 0m 37s There were no new shellcheck issues.
+1 💚 shelldocs 0m 17s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 14m 20s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 35s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 44s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 5s the patch passed
_ Other Tests _
-1 ❌ unit 135m 34s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 46s The patch does not generate ASF License warnings.
231m 35s
Reason Tests
Failed junit tests hadoop.hdfs.TestErasureCodingExerciseAPIs
hadoop.hdfs.server.namenode.TestReencryption
hadoop.hdfs.TestGetFileChecksum
hadoop.hdfs.TestDFSStorageStateRecovery
hadoop.hdfs.TestReadStripedFileWithDecodingCorruptData
hadoop.security.TestPermission
hadoop.hdfs.TestDecommissionWithStripedBackoffMonitor
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy
hadoop.hdfs.server.namenode.TestAddOverReplicatedStripedBlocks
hadoop.hdfs.TestDFSInputStreamBlockLocations
hadoop.hdfs.TestFileAppend2
hadoop.hdfs.TestLeaseRecovery
hadoop.hdfs.TestErasureCodingMultipleRacks
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
hadoop.hdfs.TestDFSStripedInputStream
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
hadoop.hdfs.tools.TestECAdmin
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.TestFileAppend4
hadoop.hdfs.TestDFSStartupVersions
hadoop.hdfs.TestFileChecksum
hadoop.hdfs.server.balancer.TestBalancer
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 39e5f5ff7c42 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1f71c4a
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/testReport/
Max. process+thread count 4061 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/3/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 1m 15s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 21m 28s trunk passed
+1 💚 compile 1m 17s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 11s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 49s trunk passed
+1 💚 mvnsite 1m 19s trunk passed
+1 💚 shadedclient 15m 41s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 37s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 44s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 3s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 3m 1s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 9s the patch passed
+1 💚 compile 1m 11s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 11s the patch passed
+1 💚 compile 1m 4s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 4s the patch passed
-0 ⚠️ checkstyle 0m 41s hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 50 unchanged - 0 fixed = 52 total (was 50)
+1 💚 mvnsite 1m 11s the patch passed
+1 💚 shellcheck 0m 32s There were no new shellcheck issues.
+1 💚 shelldocs 0m 15s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 15m 37s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 33s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 43s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 7s the patch passed
_ Other Tests _
-1 ❌ unit 123m 15s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 45s The patch does not generate ASF License warnings.
201m 29s
Reason Tests
Failed junit tests hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.balancer.TestBalancer
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.TestEncryptionZones
hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy
hadoop.hdfs.TestGetFileChecksum
hadoop.hdfs.qjournal.client.TestQJMWithFaults
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 30f42aa5e739 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1f71c4a
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/testReport/
Max. process+thread count 2715 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/4/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 42s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 1s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 22m 14s trunk passed
+1 💚 compile 1m 34s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 19s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 55s trunk passed
+1 💚 mvnsite 1m 27s trunk passed
+1 💚 shadedclient 16m 13s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 45s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 55s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 51s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 3m 48s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 25s the patch passed
+1 💚 compile 1m 23s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 23s the patch passed
+1 💚 compile 1m 18s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 18s the patch passed
-0 ⚠️ checkstyle 0m 53s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 50 unchanged - 0 fixed = 53 total (was 50)
-1 ❌ mvnsite 1m 17s hadoop-hdfs in the patch failed.
+1 💚 shellcheck 0m 38s There were no new shellcheck issues.
+1 💚 shelldocs 0m 16s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
-1 ❌ shadedclient 0m 21s patch has errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 24s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 46s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 48s the patch passed
_ Other Tests _
-1 ❌ unit 17m 45s hadoop-hdfs in the patch passed.
-1 ❌ asflicense 0m 36s The patch generated 13 ASF License warnings.
85m 26s
Reason Tests
Failed junit tests hadoop.fs.viewfs.TestViewFileSystemLinkFallback
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot
hadoop.fs.viewfs.TestNNStartupWhenViewFSOverloadSchemeEnabled
hadoop.fs.viewfs.TestViewFileSystemWithXAttrs
hadoop.fs.viewfs.TestViewFileSystemHdfs
hadoop.fs.viewfs.TestViewFSOverloadSchemeWithMountTableConfigInHDFS
hadoop.fs.viewfs.TestViewFsLinkFallback
hadoop.fs.viewfs.TestViewFileSystemOverloadSchemeWithHdfsScheme
hadoop.fs.viewfs.TestViewFsAtHdfsRoot
hadoop.hdfs.TestDatanodeConfig
hadoop.fs.viewfs.TestViewFileSystemLinkMergeSlash
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 1efd4d8b099f 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1f71c4a
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/patch-mvnsite-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/testReport/
asflicense https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/artifact/out/patch-asflicense-problems.txt
Max. process+thread count 1205 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/5/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 1m 17s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 22m 8s trunk passed
+1 💚 compile 1m 19s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 12s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 51s trunk passed
+1 💚 mvnsite 1m 18s trunk passed
+1 💚 shadedclient 15m 33s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 36s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 47s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 6s Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚 findbugs 3m 4s trunk passed
_ Patch Compile Tests _
+1 💚 mvninstall 1m 11s the patch passed
+1 💚 compile 1m 13s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 13s the patch passed
+1 💚 compile 1m 5s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 5s the patch passed
-0 ⚠️ checkstyle 0m 42s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 50 unchanged - 0 fixed = 53 total (was 50)
+1 💚 mvnsite 1m 11s the patch passed
+1 💚 shellcheck 0m 31s There were no new shellcheck issues.
+1 💚 shelldocs 0m 14s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 15m 44s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 32s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 41s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 10s the patch passed
_ Other Tests _
-1 ❌ unit 119m 13s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 41s The patch does not generate ASF License warnings.
198m 17s
Reason Tests
Failed junit tests hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFS
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.namenode.ha.TestPipelinesFailover
hadoop.hdfs.server.datanode.TestBPOfferService
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.server.blockmanagement.TestReconstructStripedBlocksWithRackAwareness
hadoop.hdfs.TestRollingUpgrade
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.TestDFSInputStream
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux dca6519fde19 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 1f71c4a
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/testReport/
Max. process+thread count 3036 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/6/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=3.1.0-RC1
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 36s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 19m 27s trunk passed
+1 💚 compile 1m 27s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 14s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 54s trunk passed
+1 💚 mvnsite 1m 21s trunk passed
+1 💚 shadedclient 14m 0s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 39s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 53s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 8s Used deprecated FindBugs config; considering switching to SpotBugs.
-1 ❌ findbugs 3m 6s hadoop-hdfs-project/hadoop-hdfs in trunk has 4 extant findbugs warnings.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 13s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 10s the patch passed
-0 ⚠️ checkstyle 0m 48s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 213 unchanged - 0 fixed = 216 total (was 213)
+1 💚 mvnsite 1m 10s the patch passed
+1 💚 shellcheck 0m 32s There were no new shellcheck issues.
+1 💚 shelldocs 0m 15s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 14m 6s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 35s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 43s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 14s the patch passed
_ Other Tests _
-1 ❌ unit 107m 12s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 44s The patch does not generate ASF License warnings.
180m 57s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestNamenodeRetryCache
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.TestPread
hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR
hadoop.hdfs.server.namenode.sps.TestStoragePolicySatisfierWithStripedFile
hadoop.hdfs.server.datanode.TestBPOfferService
hadoop.hdfs.server.namenode.TestFsck
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.server.namenode.TestFSImage
hadoop.hdfs.server.datanode.TestBlockScanner
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 7115caf059d2 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 2ba44a7
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/testReport/
Max. process+thread count 3656 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/7/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 55s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 24m 12s trunk passed
+1 💚 compile 1m 31s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 14s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 56s trunk passed
+1 💚 mvnsite 1m 24s trunk passed
+1 💚 shadedclient 16m 11s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 46s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 48s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 23s Used deprecated FindBugs config; considering switching to SpotBugs.
-1 ❌ findbugs 3m 20s hadoop-hdfs-project/hadoop-hdfs in trunk has 4 extant findbugs warnings.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 17s the patch passed
+1 💚 compile 1m 19s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 19s the patch passed
+1 💚 compile 1m 23s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 23s the patch passed
-0 ⚠️ checkstyle 0m 58s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 213 unchanged - 0 fixed = 216 total (was 213)
+1 💚 mvnsite 1m 26s the patch passed
+1 💚 shellcheck 0m 35s There were no new shellcheck issues.
+1 💚 shelldocs 0m 15s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 16m 1s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 42s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 49s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 4m 2s the patch passed
_ Other Tests _
-1 ❌ unit 103m 25s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 51s The patch does not generate ASF License warnings.
189m 12s
Reason Tests
Failed junit tests hadoop.hdfs.server.namenode.TestAddStripedBlockInFBR
hadoop.hdfs.TestPread
hadoop.hdfs.TestReadStripedFileWithDNFailure
hadoop.hdfs.TestClientProtocolForPipelineRecovery
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy
hadoop.hdfs.TestReadStripedFileWithDecoding
hadoop.hdfs.TestStripedFileAppend
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.namenode.TestNameNodeRetryCacheMetrics
hadoop.hdfs.TestDFSClientSocketSize
hadoop.hdfs.TestDFSStorageStateRecovery
hadoop.hdfs.TestDFSInotifyEventInputStreamKerberized
hadoop.hdfs.TestMultipleNNPortQOP
hadoop.hdfs.TestMultiThreadedHflush
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 76921a6499ec 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 2ba44a7
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/testReport/
Max. process+thread count 4334 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/8/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 35s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 20m 6s trunk passed
+1 💚 compile 1m 29s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 15s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 1m 0s trunk passed
+1 💚 mvnsite 1m 23s trunk passed
+1 💚 shadedclient 13m 54s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 39s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 47s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 4s Used deprecated FindBugs config; considering switching to SpotBugs.
-1 ❌ findbugs 3m 2s hadoop-hdfs-project/hadoop-hdfs in trunk has 4 extant findbugs warnings.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 14s the patch passed
+1 💚 compile 1m 17s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 17s the patch passed
+1 💚 compile 1m 11s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 11s the patch passed
-0 ⚠️ checkstyle 0m 44s hadoop-hdfs-project/hadoop-hdfs: The patch generated 3 new + 214 unchanged - 0 fixed = 217 total (was 214)
+1 💚 mvnsite 1m 10s the patch passed
+1 💚 shellcheck 0m 33s There were no new shellcheck issues.
+1 💚 shelldocs 0m 18s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 17m 5s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 40s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 49s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 46s the patch passed
_ Other Tests _
-1 ❌ unit 105m 15s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 49s The patch does not generate ASF License warnings.
183m 29s
Reason Tests
Failed junit tests hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.server.balancer.TestBalancerRPCDelay
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.namenode.ha.TestHAAppend
hadoop.hdfs.TestParallelUnixDomainRead
hadoop.hdfs.server.namenode.ha.TestEditLogTailer
hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes
hadoop.hdfs.TestDFSStripedOutputStream
hadoop.hdfs.TestDistributedFileSystem
hadoop.hdfs.TestReadStripedFileWithDNFailure
hadoop.hdfs.TestRollingUpgradeDowngrade
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 82e76f71a47b 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 2ba44a7
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/testReport/
Max. process+thread count 3678 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/9/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 33s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 18m 55s trunk passed
+1 💚 compile 1m 22s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 15s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 57s trunk passed
+1 💚 mvnsite 1m 21s trunk passed
+1 💚 shadedclient 14m 16s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 41s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 51s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 1s Used deprecated FindBugs config; considering switching to SpotBugs.
-1 ❌ findbugs 2m 59s hadoop-hdfs-project/hadoop-hdfs in trunk has 4 extant findbugs warnings.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 11s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 10s the patch passed
+1 💚 compile 1m 4s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 4s the patch passed
-0 ⚠️ checkstyle 0m 45s hadoop-hdfs-project/hadoop-hdfs: The patch generated 2 new + 214 unchanged - 0 fixed = 216 total (was 214)
+1 💚 mvnsite 1m 9s the patch passed
+1 💚 shellcheck 0m 30s There were no new shellcheck issues.
+1 💚 shelldocs 0m 17s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 13m 57s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 36s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 46s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 1s the patch passed
_ Other Tests _
-1 ❌ unit 95m 55s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 48s The patch does not generate ASF License warnings.
168m 43s
Reason Tests
Failed junit tests hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 607fa303d998 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 9965516
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
checkstyle https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/diff-checkstyle-hadoop-hdfs-project_hadoop-hdfs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/testReport/
Max. process+thread count 4325 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/10/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

bshashikant
bshashikant approved these changes Jul 19, 2020
View reviewed changes
Copy link
Contributor

@bshashikant bshashikant left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please address the checkstyle issues/javadoc issues.

@szetszwo
Copy link
Contributor Author

Thanks, @bshashikant . I just have pushed another commit to fix the whitespace checkstyle warnings in TestFsImageValidation.

The javadoc warnings do not seem related. Or have I missed anything?

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 25m 54s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
+1 💚 test4tests 0m 0s The patch appears to include 1 new or modified test files.
_ trunk Compile Tests _
+1 💚 mvninstall 19m 21s trunk passed
+1 💚 compile 1m 21s trunk passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 compile 1m 14s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 checkstyle 0m 57s trunk passed
+1 💚 mvnsite 1m 19s trunk passed
+1 💚 shadedclient 14m 1s branch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 40s hadoop-hdfs in trunk failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 51s trunk passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+0 🆗 spotbugs 3m 0s Used deprecated FindBugs config; considering switching to SpotBugs.
-1 ❌ findbugs 2m 58s hadoop-hdfs-project/hadoop-hdfs in trunk has 4 extant findbugs warnings.
_ Patch Compile Tests _
+1 💚 mvninstall 1m 12s the patch passed
+1 💚 compile 1m 10s the patch passed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04
+1 💚 javac 1m 10s the patch passed
+1 💚 compile 1m 8s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 javac 1m 8s the patch passed
+1 💚 checkstyle 0m 48s the patch passed
+1 💚 mvnsite 1m 12s the patch passed
+1 💚 shellcheck 0m 30s There were no new shellcheck issues.
+1 💚 shelldocs 0m 17s The patch generated 0 new + 104 unchanged - 132 fixed = 104 total (was 236)
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
+1 💚 shadedclient 13m 51s patch has no errors when building and testing our client artifacts.
-1 ❌ javadoc 0m 35s hadoop-hdfs in the patch failed with JDK Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.
+1 💚 javadoc 0m 44s the patch passed with JDK Private Build-1.8.0_252-8u252-b09-1~18.04-b09
+1 💚 findbugs 3m 4s the patch passed
_ Other Tests _
-1 ❌ unit 102m 0s hadoop-hdfs in the patch passed.
+1 💚 asflicense 0m 40s The patch does not generate ASF License warnings.
200m 8s
Reason Tests
Failed junit tests hadoop.hdfs.server.blockmanagement.TestUnderReplicatedBlocks
hadoop.hdfs.TestStripedFileAppend
hadoop.fs.contract.hdfs.TestHDFSContractMultipartUploader
hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped
hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier
hadoop.hdfs.server.datanode.TestBPOfferService
Subsystem Report/Notes
Docker ClientAPI=1.40 ServerAPI=1.40 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/artifact/out/Dockerfile
GITHUB PR #2140
Optional Tests dupname asflicense mvnsite unit shellcheck shelldocs compile javac javadoc mvninstall shadedclient findbugs checkstyle
uname Linux 0fa45be5f5b3 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 4101b0c
Default Java Private Build-1.8.0_252-8u252-b09-1~18.04-b09
Multi-JDK versions /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_252-8u252-b09-1~18.04-b09
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/artifact/out/branch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
findbugs https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/artifact/out/branch-findbugs-hadoop-hdfs-project_hadoop-hdfs-warnings.html
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/artifact/out/patch-javadoc-hadoop-hdfs-project_hadoop-hdfs-jdkUbuntu-11.0.7+10-post-Ubuntu-2ubuntu218.04.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/testReport/
Max. process+thread count 4610 (vs. ulimit of 5500)
modules C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-2140/11/console
versions git=2.17.1 maven=3.6.0 shellcheck=0.4.6 findbugs=4.0.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@bshashikant bshashikant merged commit 2cec50c into apache:trunk Jul 20, 2020
@bshashikant
Copy link
Contributor

Thanks @szetszwo for working on this. The findbugs/javadoc warnings are not related to the patch.

jojochuang pushed a commit to jojochuang/hadoop that referenced this pull request May 23, 2023
@szetszwo
HDFS-15463. Add a tool to validate FsImage. (apache#2140)
072a59c 
(cherry picked from commit 2cec50c)
Change-Id: I2e448edf9bcb976e5c4ce2cdb1e897eafc01db7c
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bshashikant bshashikant bshashikant approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@szetszwo @hadoop-yetus @bshashikant