HBASE-24824 Add more stats in PE for read replica #2205

huaxiangsun · 2020-08-05T23:48:23Z

Currently, added read replica stats for RandomReadTest .

huaxiangsun · 2020-08-06T00:08:04Z

Attached is the Sample output from 2.3 (apply the same patch to 2.3.0) with read replica RandomReadTest, killing a region server process during the test. Newly added text are highlighted.

huaxiangsun · 2020-08-06T00:08:32Z

Apache-HBase · 2020-08-06T00:36:27Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 47s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 34s	master passed
+1 💚	compile	0m 29s	master passed
+1 💚	shadedjars	6m 4s	branch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 24s	hbase-mapreduce in master failed.
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 14s	the patch passed
+1 💚	compile	0m 31s	the patch passed
+1 💚	javac	0m 31s	the patch passed
+1 💚	shadedjars	5m 54s	patch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 21s	hbase-mapreduce in the patch failed.
		_ Other Tests _
+1 💚	unit	9m 46s	hbase-mapreduce in the patch passed.
		35m 26s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 41f8980efa39 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `c39cad2`
Default Java	2020-01-14
javadoc	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-mapreduce.txt
javadoc	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-mapreduce.txt
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/testReport/
Max. process+thread count	4619 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-08-06T00:39:24Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 2s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 7s	master passed
+1 💚	compile	0m 25s	master passed
+1 💚	shadedjars	6m 10s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 18s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 52s	the patch passed
+1 💚	compile	0m 26s	the patch passed
+1 💚	javac	0m 26s	the patch passed
+1 💚	shadedjars	6m 7s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 18s	the patch passed
		_ Other Tests _
+1 💚	unit	14m 35s	hbase-mapreduce in the patch passed.
		38m 27s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 0e1adde6be2a 4.15.0-101-generic #102-Ubuntu SMP Mon May 11 10:07:26 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `c39cad2`
Default Java	1.8.0_232
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/testReport/
Max. process+thread count	3420 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-08-06T00:40:17Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	5m 54s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	4m 24s	master passed
+1 💚	checkstyle	0m 22s	master passed
+1 💚	spotbugs	0m 48s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 56s	the patch passed
-0 ⚠️	checkstyle	0m 20s	hbase-mapreduce: The patch generated 6 new + 36 unchanged - 3 fixed = 42 total (was 39)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	13m 50s	Patch does not cause any errors with Hadoop 3.1.2 3.2.1.
+1 💚	spotbugs	0m 59s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 15s	The patch does not generate ASF License warnings.
		39m 15s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle
uname	Linux c6330908658f 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `c39cad2`
checkstyle	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-mapreduce.txt
Max. process+thread count	94 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/1/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

huaxiangsun · 2020-08-06T16:33:53Z

Sorry, just realized that I added two more options and need to add them to the help message. Will upload a new patch with these help messages.

huaxiangsun · 2020-08-07T00:35:53Z

Update with a help message for newly added latencyThreshold.

Apache-HBase · 2020-08-07T01:14:21Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	3m 23s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ master Compile Tests _
+1 💚	mvninstall	3m 30s	master passed
+1 💚	checkstyle	0m 18s	master passed
+1 💚	spotbugs	0m 42s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 20s	the patch passed
-0 ⚠️	checkstyle	0m 18s	hbase-mapreduce: The patch generated 6 new + 36 unchanged - 3 fixed = 42 total (was 39)
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	11m 19s	Patch does not cause any errors with Hadoop 3.1.2 3.2.1.
+1 💚	spotbugs	1m 9s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 13s	The patch does not generate ASF License warnings.
		33m 15s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle
uname	Linux aea23ba5c068 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `f710d2d`
checkstyle	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-general-check/output/diff-checkstyle-hbase-mapreduce.txt
Max. process+thread count	94 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-08-07T01:14:31Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 27s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	4m 20s	master passed
+1 💚	compile	0m 28s	master passed
+1 💚	shadedjars	5m 53s	branch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 24s	hbase-mapreduce in master failed.
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 2s	the patch passed
+1 💚	compile	0m 28s	the patch passed
+1 💚	javac	0m 28s	the patch passed
+1 💚	shadedjars	5m 46s	patch has no errors when building our shaded downstream artifacts.
-0 ⚠️	javadoc	0m 20s	hbase-mapreduce in the patch failed.
		_ Other Tests _
+1 💚	unit	10m 11s	hbase-mapreduce in the patch passed.
		33m 32s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 90c59be8fc57 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `f710d2d`
Default Java	2020-01-14
javadoc	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-mapreduce.txt
javadoc	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-mapreduce.txt
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/testReport/
Max. process+thread count	3739 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2020-08-07T01:17:19Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	3m 23s	Docker mode activated.
-0 ⚠️	yetus	0m 3s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ master Compile Tests _
+1 💚	mvninstall	3m 48s	master passed
+1 💚	compile	0m 26s	master passed
+1 💚	shadedjars	5m 43s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 20s	master passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 24s	the patch passed
+1 💚	compile	0m 26s	the patch passed
+1 💚	javac	0m 26s	the patch passed
+1 💚	shadedjars	5m 48s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 18s	the patch passed
		_ Other Tests _
+1 💚	unit	11m 27s	hbase-mapreduce in the patch passed.
		36m 15s

Subsystem	Report/Notes
Docker	Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR	#2205
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux ac2134fdc3d3 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	master / `f710d2d`
Default Java	1.8.0_232
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/testReport/
Max. process+thread count	3719 (vs. ulimit of 12500)
modules	C: hbase-mapreduce U: hbase-mapreduce
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2205/2/console
versions	git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f)
Powered by	Apache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

Signed-off-by: stack <stack@apache.org>

…he#2212) Signed-off-by: stack <stack@apache.org>

saintstack approved these changes Aug 6, 2020

View reviewed changes

HBASE-24824 Add more stats in PE for read replica

5872668

huaxiangsun force-pushed the master.HBASE-24824 branch from 4ff9175 to 5872668 Compare August 7, 2020 00:34

huaxiangsun merged commit 6ef90aa into apache:master Aug 7, 2020

huaxiangsun added a commit to huaxiangsun/hbase that referenced this pull request Aug 7, 2020

HBASE-24824 Add more stats in PE for read replica (apache#2205)

f5f75ae

Signed-off-by: stack <stack@apache.org>

huaxiangsun added a commit to huaxiangsun/hbase that referenced this pull request Aug 7, 2020

HBASE-24824 Add more stats in PE for read replica (apache#2205)

a63f165

Signed-off-by: stack <stack@apache.org>

huaxiangsun added a commit that referenced this pull request Aug 10, 2020

HBASE-24824 Add more stats in PE for read replica (#2205) (#2213)

d2b82cb

Signed-off-by: stack <stack@apache.org>

huaxiangsun added a commit that referenced this pull request Aug 10, 2020

HBASE-24824 Add more stats in PE for read replica (#2205) (#2212)

bd30555

Signed-off-by: stack <stack@apache.org>

clarax pushed a commit to clarax/hbase that referenced this pull request Nov 15, 2020

HBASE-24824 Add more stats in PE for read replica (apache#2205) (apac…

b10f72b

…he#2212) Signed-off-by: stack <stack@apache.org>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HBASE-24824 Add more stats in PE for read replica #2205

HBASE-24824 Add more stats in PE for read replica #2205

huaxiangsun commented Aug 5, 2020

huaxiangsun commented Aug 6, 2020

huaxiangsun commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

huaxiangsun commented Aug 6, 2020

huaxiangsun commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020

HBASE-24824 Add more stats in PE for read replica #2205

HBASE-24824 Add more stats in PE for read replica #2205

Conversation

huaxiangsun commented Aug 5, 2020

huaxiangsun commented Aug 6, 2020

huaxiangsun commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

Apache-HBase commented Aug 6, 2020

huaxiangsun commented Aug 6, 2020

huaxiangsun commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020

Apache-HBase commented Aug 7, 2020