HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME #4204

apurtell · 2022-03-10T19:47:16Z

Change the timing of the test but not the objective by storing three large MOB values into the row with three separate puts, each randomizing the data. Increases running time of the testGetMassive case 2x but avoids OOME in the test environment where the OOME was consistently reproducible.

Change the timing of the test but not the objective by storing three large MOB values into the row with three separate puts, each randomizing the data. Increases running time of the testGetMassive case 2x but avoids OOME in the test environment where the OOME was consistently reproductable.

Apache-HBase · 2022-03-10T20:21:21Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 2s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	2m 41s	master passed
+1 💚	compile	2m 13s	master passed
+1 💚	checkstyle	0m 37s	master passed
+1 💚	spotbugs	1m 14s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	2m 19s	the patch passed
+1 💚	compile	2m 11s	the patch passed
+1 💚	javac	2m 11s	the patch passed
+1 💚	checkstyle	0m 32s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	11m 24s	Patch does not cause any errors with Hadoop 3.1.2 3.2.2 3.3.1.
+1 💚	spotbugs	1m 16s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 9s	The patch does not generate ASF License warnings.
		31m 0s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#4204
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile
uname	Linux 6e79a4063ddd 5.4.0-1054-aws #57~18.04.1-Ubuntu SMP Thu Jul 15 03:21:36 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `4da53ef`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count	60 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-03-11T01:23:05Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 36s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 3s	master passed
+1 💚	compile	0m 35s	master passed
+1 💚	shadedjars	3m 48s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 22s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	2m 25s	the patch passed
+1 💚	compile	0m 34s	the patch passed
+1 💚	javac	0m 34s	the patch passed
+1 💚	shadedjars	3m 50s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 21s	the patch passed
		_ Other Tests _
+1 💚	unit	314m 37s	hbase-server in the patch passed.
		332m 48s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#4204
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux d77e4aeada80 5.4.0-1025-aws #25~18.04.1-Ubuntu SMP Fri Sep 11 12:03:04 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `4da53ef`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/testReport/
Max. process+thread count	3376 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-03-11T01:42:20Z

💔 -1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 52s	Docker mode activated.
-0 ⚠️	yetus	0m 2s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	3m 10s	master passed
+1 💚	compile	0m 42s	master passed
+1 💚	shadedjars	3m 50s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 25s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	2m 46s	the patch passed
+1 💚	compile	0m 40s	the patch passed
+1 💚	javac	0m 40s	the patch passed
+1 💚	shadedjars	3m 49s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 24s	the patch passed
		_ Other Tests _
-1 ❌	unit	333m 26s	hbase-server in the patch failed.
		352m 1s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#4204
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 143fdc7f9993 5.4.0-1025-aws #25~18.04.1-Ubuntu SMP Fri Sep 11 12:03:04 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `4da53ef`
Default Java	AdoptOpenJDK-11.0.10+9
unit	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt
Test Results	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/testReport/
Max. process+thread count	1982 (vs. ulimit of 30000)
modules	C: hbase-server U: hbase-server
Console output	https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4204/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Change the timing of the test but not the objective by storing three large MOB values into the row with three separate puts, each randomizing the data. Increases running time of the testGetMassive case 2x but avoids OOME in the test environment where the OOME was consistently reproductable. Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>

Change the timing of the test but not the objective by storing three large MOB values into the row with three separate puts, each randomizing the data. Increases running time of the testGetMassive case 2x but avoids OOME in the test environment where the OOME was consistently reproductable. Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Pankaj Kumar <pankajkumar@apache.org> (cherry picked from commit 40f8738) Change-Id: I1535e754190c8d7e3dd0dee70b70ac005e615b06

apurtell requested review from Apache9 and pankaj72981 March 10, 2022 19:47

Apache9 approved these changes Mar 11, 2022

View reviewed changes

pankaj72981 approved these changes Mar 11, 2022

View reviewed changes

Apache9 merged commit 71ff3ec into apache:master Mar 11, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME #4204

HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME #4204

Uh oh!

apurtell commented Mar 10, 2022 •

edited

Loading

Uh oh!

Apache-HBase commented Mar 10, 2022

Uh oh!

Apache-HBase commented Mar 11, 2022

Uh oh!

Apache-HBase commented Mar 11, 2022

Uh oh!

Uh oh!

HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME #4204

HBASE-26761 TestMobStoreScanner (testGetMassive) can OOME #4204

Uh oh!

Conversation

apurtell commented Mar 10, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Apache-HBase commented Mar 10, 2022

Uh oh!

Apache-HBase commented Mar 11, 2022

Uh oh!

Apache-HBase commented Mar 11, 2022

Uh oh!

Uh oh!

apurtell commented Mar 10, 2022 •

edited

Loading