HBASE-28906 Run nightly tests with multiple Hadoop 3 versions (#6356)… #6417

stoty · 2024-10-30T11:52:06Z

includes HBASE-28929 Set hadoop-three.version in Hadoop 3 backwards compatibility tests includes addendum: workaround for MAPREDUCE-7492
includes HBASE-28940 Do not run the backwards compatibility tests with the default Hadoop3 version

Signed-off-by: Nick Dimiduk ndimiduk@apache.org
Signed-off-by: Duo Zhang zhangduo@apache.org
(cherry picked from commit 4be7e39)

…#6356) (apache#6399) includes HBASE-28929 Set hadoop-three.version in Hadoop 3 backwards compatibility tests includes addendum: workaround for MAPREDUCE-7492 includes HBASE-28940 Do not run the backwards compatibility tests with the default Hadoop3 version Signed-off-by: Nick Dimiduk <ndimiduk@apache.org> Signed-off-by: Duo Zhang <zhangduo@apache.org> (cherry picked from commit 4be7e39)

Apache-HBase · 2024-10-30T12:06:33Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console in case of problems.

Apache-HBase · 2024-10-30T12:06:40Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console in case of problems.

Apache-HBase · 2024-10-30T12:06:40Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console in case of problems.

Apache-HBase · 2024-10-30T12:06:48Z

(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console in case of problems.

Apache-HBase · 2024-10-30T12:07:30Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 27s		Docker mode activated.
-0 ⚠️	yetus	0m 7s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 14s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 7s		Maven dependency ordering for patch
			_ Other Tests _
		1m 51s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#6417
Optional Tests
uname	Linux 1aae9ec956ff 5.4.0-192-generic #212-Ubuntu SMP Fri Jul 5 09:47:39 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da332e5`
Max. process+thread count	32 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-10-30T12:08:00Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 58s		Docker mode activated.
-0 ⚠️	yetus	0m 7s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 15s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 5s		Maven dependency ordering for patch
			_ Other Tests _
		2m 19s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#6417
Optional Tests
uname	Linux 0fbfaca3e47d 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da332e5`
Max. process+thread count	38 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-10-30T12:08:09Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 58s		Docker mode activated.
-0 ⚠️	yetus	0m 6s		Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
			_ Prechecks _
			_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 16s		Maven dependency ordering for branch
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 8s		Maven dependency ordering for patch
			_ Other Tests _
		2m 30s

Subsystem	Report/Notes
Docker	ClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR	#6417
Optional Tests
uname	Linux 733155cfd65c 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da332e5`
Max. process+thread count	39 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console
versions	git=2.34.1 maven=3.9.8
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2024-10-30T12:09:19Z

🎊 +1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 51s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
			_ branch-2.5 Compile Tests _
+0 🆗	mvndep	0m 13s		Maven dependency ordering for branch
+1 💚	spotless	0m 46s		branch has no errors when running spotless:check.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 5s		Maven dependency ordering for patch
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	shellcheck	0m 2s		No new issues.
+1 💚	spotless	0m 41s		patch has no errors when running spotless:check.
			_ Other Tests _
+0 🆗	asflicense	0m 0s		ASF License check generated no output?
		3m 43s

Subsystem	Report/Notes
Docker	ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#6417
Optional Tests	dupname asflicense codespell detsecrets shellcheck shelldocs spotless
uname	Linux e06bdfaa7bd5 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2.5 / `da332e5`
Max. process+thread count	44 (vs. ulimit of 30000)
modules	C: U:
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6417/1/console
versions	git=2.34.1 maven=3.9.8 shellcheck=0.8.0
Powered by	Apache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

Apache9

I suppose we just align the related files with other branches?

stoty · 2024-10-30T15:00:24Z

Yes.
I applied the branch-2 patch
Overrwritten the Jenkinsfile completely with the 2.6 version
Then added Hadoop 3.2.4 to the list and set it as the default.

NihalJain mentioned this pull request Oct 30, 2024

HBASE-28945 Update nightlies to run with HADOOP3_VERSION = 3.2.4 #6418

Closed

Apache9 approved these changes Oct 30, 2024

View reviewed changes

stoty merged commit 45e8810 into apache:branch-2.5 Oct 30, 2024
1 check passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

HBASE-28906 Run nightly tests with multiple Hadoop 3 versions (#6356)… #6417

HBASE-28906 Run nightly tests with multiple Hadoop 3 versions (#6356)… #6417

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache9 left a comment

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

Uh oh!

Uh oh!

HBASE-28906 Run nightly tests with multiple Hadoop 3 versions (#6356)… #6417

HBASE-28906 Run nightly tests with multiple Hadoop 3 versions (#6356)… #6417

Uh oh!

Conversation

stoty commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache-HBase commented Oct 30, 2024

Uh oh!

Apache9 left a comment

Choose a reason for hiding this comment

Uh oh!

stoty commented Oct 30, 2024

Uh oh!

Uh oh!

Uh oh!