Hadoop 16524 - resubmission following some unit test fixes #2693

bolerio · 2021-02-09T06:17:15Z

This is a follow up on this PR which was rejected due to some failed unit tests #2470 that were missed initially.

Most of the failures reported here appears to be flaky tests as they passed when run locally:

https://issues.apache.org/jira/browse/HADOOP-16524?focusedCommentId=17262765&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17262765

I've address the one test that was clearly broken by the PR and also including another unit test fix in the same vein.

hadoop-yetus · 2021-02-09T14:54:47Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 17s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚		0m 0s	test4tests	The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	13m 57s		Maven dependency ordering for branch
+1 💚	mvninstall	23m 9s		trunk passed
+1 💚	compile	22m 27s		trunk passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	compile	19m 0s		trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚	checkstyle	3m 59s		trunk passed
+1 💚	mvnsite	7m 56s		trunk passed
+1 💚	shadedclient	27m 41s		branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	4m 49s		trunk passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	5m 30s		trunk passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+0 🆗	spotbugs	1m 51s		Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚	findbugs	18m 54s		trunk passed
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 21s		Maven dependency ordering for patch
+1 💚	mvninstall	6m 56s		the patch passed
+1 💚	compile	21m 39s		the patch passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javac	21m 39s		the patch passed
+1 💚	compile	19m 20s		the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚	javac	19m 20s		the patch passed
-0 ⚠️	checkstyle	4m 1s	/diff-checkstyle-root.txt	root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚	mvnsite	8m 44s		the patch passed
+1 💚	whitespace	0m 0s		The patch has no whitespace issues.
+1 💚	xml	0m 1s		The patch has no ill-formed XML file.
+1 💚	shadedclient	15m 54s		patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	5m 0s		the patch passed with JDK Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	5m 53s		the patch passed with JDK Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
+1 💚	findbugs	21m 4s		the patch passed
			_ Other Tests _
+1 💚	unit	17m 39s		hadoop-common in the patch passed.
+1 💚	unit	2m 18s		hadoop-hdfs-client in the patch passed.
-1 ❌	unit	240m 53s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch passed.
+1 💚	unit	4m 7s		hadoop-yarn-common in the patch passed.
+1 💚	asflicense	0m 48s		The patch does not generate ASF License warnings.
		515m 28s

Reason	Tests
Failed junit tests	hadoop.yarn.server.resourcemanager.TestRMRestart
	hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer
	hadoop.yarn.server.timelineservice.storage.TestTimelineWriterHBaseDown

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml
uname	Linux 74b0f841c262 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `2df2dfb`
Default Java	Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.9.1+1-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_275-8u275-b01-0ubuntu1~20.04-b01
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/testReport/
Max. process+thread count	1681 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/1/console
versions	git=2.25.1 maven=3.6.3 findbugs=4.0.6
Powered by	Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2021-02-12T15:42:27Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	23m 9s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚		0m 0s	test4tests	The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	13m 48s		Maven dependency ordering for branch
+1 💚	mvninstall	22m 44s		trunk passed
+1 💚	compile	22m 14s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	compile	18m 58s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	checkstyle	3m 57s		trunk passed
+1 💚	mvnsite	12m 35s		trunk passed
+1 💚	shadedclient	32m 28s		branch has no errors when building and testing our client artifacts.
+1 💚	javadoc	7m 37s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 0s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+0 🆗	spotbugs	12m 23s		Used deprecated FindBugs config; considering switching to SpotBugs.
+1 💚	findbugs	31m 2s		trunk passed
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 20s		Maven dependency ordering for patch
+1 💚	mvninstall	11m 29s		the patch passed
+1 💚	compile	21m 43s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javac	21m 43s		the patch passed
+1 💚	compile	18m 54s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	javac	18m 54s		the patch passed
-0 ⚠️	checkstyle	3m 59s	/diff-checkstyle-root.txt	root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚	mvnsite	12m 36s		the patch passed
-1 ❌	whitespace	0m 0s	/whitespace-eol.txt	The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 💚	xml	0m 2s		The patch has no ill-formed XML file.
+1 💚	shadedclient	15m 19s		patch has no errors when building and testing our client artifacts.
+1 💚	javadoc	7m 36s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	7m 59s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	findbugs	31m 51s		the patch passed
			_ Other Tests _
+1 💚	unit	17m 6s		hadoop-common in the patch passed.
+1 💚	unit	2m 18s		hadoop-hdfs-client in the patch passed.
-1 ❌	unit	232m 25s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch passed.
+1 💚	unit	4m 7s		hadoop-yarn-common in the patch passed.
-1 ❌	unit	227m 28s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch passed.
+1 💚	asflicense	0m 48s		The patch does not generate ASF License warnings.
		800m 35s

Reason	Tests
Failed junit tests	hadoop.yarn.applications.distributedshell.TestDSTimelineV10
	hadoop.yarn.applications.distributedshell.TestDSTimelineV10

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient findbugs checkstyle xml
uname	Linux 36ac8935757d 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `f9a073c`
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/testReport/
Max. process+thread count	1245 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/2/console
versions	git=2.25.1 maven=3.6.3 findbugs=4.0.6
Powered by	Apache Yetus 0.13.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

saintstack · 2021-03-22T17:51:41Z

I see:

[ERROR] Tests run: 21, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 450.303 s <<< FAILURE! - in org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV10
[ERROR] testDSShellWithoutDomain(org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV10)  Time elapsed: 28.293 s  <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<3>

.... and a few other unrelated.

hadoop-yetus · 2021-03-24T19:17:18Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 56s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 2s		Maven dependency ordering for branch
+1 💚	mvninstall	23m 40s		trunk passed
+1 💚	compile	22m 49s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	compile	19m 4s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	checkstyle	4m 0s		trunk passed
+1 💚	mvnsite	12m 38s		trunk passed
+1 💚	javadoc	7m 38s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 4s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	31m 25s		trunk passed
+1 💚	shadedclient	27m 51s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 23s		Maven dependency ordering for patch
+1 💚	mvninstall	13m 26s		the patch passed
+1 💚	compile	25m 11s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javac	25m 11s		the patch passed
+1 💚	compile	21m 47s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	javac	21m 47s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-0 ⚠️	checkstyle	4m 2s	/results-checkstyle-root.txt	root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚	mvnsite	13m 5s		the patch passed
+1 💚	xml	0m 3s		The patch has no ill-formed XML file.
+1 💚	javadoc	8m 9s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 27s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	35m 29s		the patch passed
+1 💚	shadedclient	28m 3s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 20s		hadoop-common in the patch passed.
+1 💚	unit	2m 17s		hadoop-hdfs-client in the patch passed.
-1 ❌	unit	232m 21s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch passed.
+1 💚	unit	4m 44s		hadoop-yarn-common in the patch passed.
-1 ❌	unit	232m 37s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch passed.
+1 💚	asflicense	0m 53s		The patch does not generate ASF License warnings.
		800m 42s

Reason	Tests
Failed junit tests	hadoop.yarn.server.resourcemanager.TestRMRestart
	hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor
	hadoop.yarn.server.resourcemanager.TestRMRestart
	hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname	Linux cb51398718fa 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `7763309`
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/testReport/
Max. process+thread count	1245 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/4/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2021-03-26T00:39:42Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 3s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 5s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 26s		trunk passed
+1 💚	compile	28m 38s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	compile	24m 9s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	checkstyle	4m 43s		trunk passed
+1 💚	mvnsite	16m 2s		trunk passed
+1 💚	javadoc	9m 9s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	9m 22s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	40m 2s		trunk passed
+1 💚	shadedclient	34m 15s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 25s		Maven dependency ordering for patch
+1 💚	mvninstall	15m 36s		the patch passed
+1 💚	compile	31m 14s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javac	31m 14s		the patch passed
+1 💚	compile	20m 47s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	javac	20m 47s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-0 ⚠️	checkstyle	3m 59s	/results-checkstyle-root.txt	root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚	mvnsite	12m 25s		the patch passed
+1 💚	xml	0m 3s		The patch has no ill-formed XML file.
+1 💚	javadoc	7m 36s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	7m 57s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	32m 16s		the patch passed
+1 💚	shadedclient	28m 4s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 22s		hadoop-common in the patch passed.
-1 ❌	unit	0m 56s	/patch-unit-hadoop-hdfs-project_hadoop-hdfs-client.txt	hadoop-hdfs-client in the patch failed.
-1 ❌	unit	4m 38s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch failed.
-1 ❌	unit	0m 53s	/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt	hadoop-yarn-common in the patch failed.
-1 ❌	unit	4m 40s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch failed.
+1 💚	asflicense	0m 48s		The patch does not generate ASF License warnings.
		376m 29s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname	Linux 51dd69dcf22b 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `7763309`
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/testReport/
Max. process+thread count	3136 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/5/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

saintstack · 2021-03-26T16:03:45Z

Unrelated failure:

[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.1:testCompile (default-testCompile) on project hadoop-yarn-common: Compilation failure: Compilation failure: 
[ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-2693/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestTimelineClient.java:[44] error: cannot find symbol
[ERROR] /home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-2693/src/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/client/api/impl/TestTimelineClient.java:[480,40] error: cannot find symbol

saintstack · 2021-03-29T21:20:47Z

Build 5 had compilation error... from elsewhere? Checking local, all compiles now. Retrying...

bolerio · 2021-03-30T06:10:24Z

Thanks for retrying @saintstack . I did pull latest trunk to check for compilation errors locally and all went fine, must have been a temporary issue from elsewhere.

hadoop-yetus · 2021-03-30T10:41:21Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 54s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	13m 58s		Maven dependency ordering for branch
+1 💚	mvninstall	23m 12s		trunk passed
+1 💚	compile	22m 34s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	compile	18m 57s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	checkstyle	3m 56s		trunk passed
+1 💚	mvnsite	12m 32s		trunk passed
+1 💚	javadoc	7m 38s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 5s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	31m 24s		trunk passed
+1 💚	shadedclient	27m 51s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 47s		Maven dependency ordering for patch
+1 💚	mvninstall	11m 49s		the patch passed
+1 💚	compile	21m 39s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javac	21m 39s		the patch passed
+1 💚	compile	19m 3s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	javac	19m 3s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-0 ⚠️	checkstyle	3m 54s	/results-checkstyle-root.txt	root: The patch generated 169 new + 92 unchanged - 11 fixed = 261 total (was 103)
+1 💚	mvnsite	12m 33s		the patch passed
+1 💚	xml	0m 2s		The patch has no ill-formed XML file.
+1 💚	javadoc	7m 35s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	7m 59s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	32m 19s		the patch passed
+1 💚	shadedclient	28m 0s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 12s		hadoop-common in the patch passed.
+1 💚	unit	2m 17s		hadoop-hdfs-client in the patch passed.
-1 ❌	unit	231m 46s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch passed.
+1 💚	unit	4m 44s		hadoop-yarn-common in the patch passed.
-1 ❌	unit	244m 53s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch passed.
+1 💚	asflicense	1m 52s		The patch does not generate ASF License warnings.
		799m 34s

Reason	Tests
Failed junit tests	hadoop.yarn.applications.distributedshell.TestDSTimelineV15
	hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore
	hadoop.yarn.applications.distributedshell.TestDSTimelineV15
	hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname	Linux 0e4c8723d26b 4.15.0-128-generic #131-Ubuntu SMP Wed Dec 9 06:57:35 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `7763309`
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/testReport/
Max. process+thread count	1584 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/6/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

saintstack · 2021-03-30T17:40:03Z

Build #4 had these tests fail:
org.apache.hadoop.yarn.applications.distributedshell.TestDSTimelineV15.testDSShellWithDomain
org.apache.hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore.testFSRMStateStore

Build #5 had compile issue.

Build #6 failed w/ these issues:

org.apache.hadoop.yarn.server.resourcemanager.TestRMRestart.testRMRestartOnMissingAttempts[FAIR]
org.apache.hadoop.yarn.server.router.clientrm.TestFederationClientInterceptor.testGetApplicationAttemptReport

None seem related. Will run one more build to be sure.

hadoop-yetus · 2021-03-31T02:47:20Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	13m 41s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
+1 💚	test4tests	0m 0s		The patch appears to include 4 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 14s		Maven dependency ordering for branch
+1 💚	mvninstall	20m 11s		trunk passed
+1 💚	compile	20m 43s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	compile	17m 56s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	checkstyle	3m 47s		trunk passed
+1 💚	mvnsite	12m 46s		trunk passed
+1 💚	javadoc	7m 48s		trunk passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 13s		trunk passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	29m 25s		trunk passed
+1 💚	shadedclient	24m 26s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 25s		Maven dependency ordering for patch
+1 💚	mvninstall	11m 15s		the patch passed
+1 💚	compile	20m 0s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javac	20m 0s		the patch passed
+1 💚	compile	17m 56s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	javac	17m 56s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
-0 ⚠️	checkstyle	3m 47s	/results-checkstyle-root.txt	root: The patch generated 169 new + 93 unchanged - 11 fixed = 262 total (was 104)
+1 💚	mvnsite	12m 37s		the patch passed
+1 💚	xml	0m 2s		The patch has no ill-formed XML file.
+1 💚	javadoc	7m 45s		the patch passed with JDK Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 6s		the patch passed with JDK Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
+1 💚	spotbugs	30m 27s		the patch passed
+1 💚	shadedclient	24m 56s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	17m 11s		hadoop-common in the patch passed.
+1 💚	unit	2m 27s		hadoop-hdfs-client in the patch passed.
-1 ❌	unit	226m 44s	/patch-unit-hadoop-yarn-project_hadoop-yarn.txt	hadoop-yarn in the patch passed.
-1 ❌	unit	1m 10s	/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt	hadoop-yarn-common in the patch failed.
-1 ❌	unit	4m 35s	/patch-unit-hadoop-yarn-project.txt	hadoop-yarn-project in the patch failed.
+1 💚	asflicense	1m 3s		The patch does not generate ASF License warnings.
		546m 6s

Reason	Tests
Failed junit tests	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit
	hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling
	hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit
	hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/artifact/out/Dockerfile
GITHUB PR	#2693
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient spotbugs checkstyle codespell xml
uname	Linux 874fc760dd26 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `7763309`
Default Java	Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.10+9-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_282-8u282-b08-0ubuntu1~20.04-b08
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/testReport/
Max. process+thread count	2754 (vs. ulimit of 5500)
modules	C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-yarn-project/hadoop-yarn hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-2693/7/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

saintstack · 2021-03-31T16:42:42Z

Failures this time through are the below, new failures.

org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacitySchedulerAsyncScheduling.testAsyncSchedulerSkipNoRunningNMs
org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit.testKillMultipleContainers

Let me merge. Each build has new flakies fail.

…2693)" Revert to fix the summary message. This reverts commit 9509beb.

Signed-off-by: stack <stack@apache.org>

…pache#2693)" Revert to fix the summary message. This reverts commit 9509beb.

Borislav Iordanov added 5 commits November 17, 2020 21:41

HADOOP-16524. Reloading SSL keystore for both DataNode and NameNode

d36f054

addressing PR comments by saintstack

be6b9cc

few more cosmetic fixes

142740f

Merge branch 'trunk' into HADOOP-16524

de36b72

Fixes some failing unit tests that were missed on PR apache#2470

5f7f8df

Borislav Iordanov added 2 commits February 9, 2021 16:22

Merge remote-tracking branch 'upstream/trunk' into HADOOP-16524

416dd62

cosmetic change to re-run unit tests

88983ac

remove whitespace added to trigger YARN unit tests

7763309

saintstack merged commit 9509beb into apache:trunk Mar 31, 2021

asfgit pushed a commit that referenced this pull request Mar 31, 2021

Revert "Hadoop 16524 - resubmission following some unit test fixes (#…

5183aae

…2693)" Revert to fix the summary message. This reverts commit 9509beb.

kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021

Hadoop 16524 - resubmission following some unit test fixes (apache#2693)

6a06e65

Signed-off-by: stack <stack@apache.org>

kiran-maturi pushed a commit to kiran-maturi/hadoop that referenced this pull request Nov 24, 2021

Revert "Hadoop 16524 - resubmission following some unit test fixes (a…

6e8a3f2

…pache#2693)" Revert to fix the summary message. This reverts commit 9509beb.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Hadoop 16524 - resubmission following some unit test fixes #2693

Hadoop 16524 - resubmission following some unit test fixes #2693

Uh oh!

bolerio commented Feb 9, 2021

Uh oh!

hadoop-yetus commented Feb 9, 2021

Uh oh!

hadoop-yetus commented Feb 12, 2021

Uh oh!

saintstack commented Mar 22, 2021

Uh oh!

hadoop-yetus commented Mar 24, 2021

Uh oh!

hadoop-yetus commented Mar 26, 2021

Uh oh!

saintstack commented Mar 26, 2021

Uh oh!

saintstack commented Mar 29, 2021

Uh oh!

bolerio commented Mar 30, 2021

Uh oh!

hadoop-yetus commented Mar 30, 2021

Uh oh!

saintstack commented Mar 30, 2021

Uh oh!

hadoop-yetus commented Mar 31, 2021

Uh oh!

saintstack commented Mar 31, 2021 •

edited

Loading

Uh oh!

Uh oh!

Hadoop 16524 - resubmission following some unit test fixes #2693

Hadoop 16524 - resubmission following some unit test fixes #2693

Uh oh!

Conversation

bolerio commented Feb 9, 2021

Uh oh!

hadoop-yetus commented Feb 9, 2021

Uh oh!

hadoop-yetus commented Feb 12, 2021

Uh oh!

saintstack commented Mar 22, 2021

Uh oh!

hadoop-yetus commented Mar 24, 2021

Uh oh!

hadoop-yetus commented Mar 26, 2021

Uh oh!

saintstack commented Mar 26, 2021

Uh oh!

saintstack commented Mar 29, 2021

Uh oh!

bolerio commented Mar 30, 2021

Uh oh!

hadoop-yetus commented Mar 30, 2021

Uh oh!

saintstack commented Mar 30, 2021

Uh oh!

hadoop-yetus commented Mar 31, 2021

Uh oh!

saintstack commented Mar 31, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

saintstack commented Mar 31, 2021 •

edited

Loading