Skip to content

HDDS-2119. Use checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation. #1435

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 2 commits into from

Conversation

nandakumar131
Copy link
Contributor

After #1423 hdds/ozone no more relies on hadoop parent pom, so we have to use separate checkstyle.xml and suppressions.xml in hdds/ozone projects for checkstyle validation.


Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line

}
.b td {
background: #fff;
}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line


}
h2 {
font-weight:bold;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line

}
h2 {
font-weight:bold;
font-size:140%;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line

h2 {
font-weight:bold;
font-size:140%;
margin-bottom: 5;

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 136 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 76 Maven dependency ordering for branch
+1 mvninstall 2041 trunk passed
+1 compile 1366 trunk passed
-1 mvnsite 1285 root in trunk failed.
+1 shadedclient 5556 branch has no errors when building and testing our client artifacts.
-1 javadoc 376 root in trunk failed.
_ Patch Compile Tests _
0 mvndep 27 Maven dependency ordering for patch
-1 mvninstall 20 root in the patch failed.
-1 mvninstall 18 hadoop-ozone in the patch failed.
-1 mvninstall 16 build-tools in the patch failed.
-1 compile 20 root in the patch failed.
-1 javac 20 root in the patch failed.
-1 mvnsite 20 root in the patch failed.
-1 whitespace 0 The patch 5 line(s) with tabs.
+1 xml 7 The patch has no ill-formed XML file.
+1 shadedclient 856 patch has no errors when building and testing our client artifacts.
-1 javadoc 22 root in the patch failed.
_ Other Tests _
-1 unit 23 root in the patch failed.
+1 asflicense 38 The patch does not generate ASF License warnings.
7318
Subsystem Report/Notes
Docker Client=19.03.2 Server=19.03.2 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/Dockerfile
GITHUB PR #1435
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux f31165afa566 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 4852a90
Default Java 1.8.0_212
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/branch-mvnsite-root.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/branch-javadoc-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-mvninstall-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-mvninstall-hadoop-ozone.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-mvninstall-hadoop-ozone_build-tools.txt
compile https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-compile-root.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-compile-root.txt
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-mvnsite-root.txt
whitespace https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/whitespace-tabs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-javadoc-root.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/testReport/
Max. process+thread count 333 (vs. ulimit of 5500)
modules C: . hadoop-ozone hadoop-ozone/build-tools U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/1/console
versions git=2.7.4 maven=3.3.9
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

Copy link
Contributor

@adoroszlai adoroszlai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @nandakumar131 for working on this.

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 40 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 67 Maven dependency ordering for branch
+1 mvninstall 1472 trunk passed
+1 compile 1224 trunk passed
-1 mvnsite 1118 root in trunk failed.
+1 shadedclient 4588 branch has no errors when building and testing our client artifacts.
-1 javadoc 371 root in trunk failed.
_ Patch Compile Tests _
0 mvndep 36 Maven dependency ordering for patch
-1 mvninstall 27 root in the patch failed.
-1 mvninstall 23 hadoop-hdds in the patch failed.
-1 mvninstall 23 build-tools in the patch failed.
-1 compile 27 root in the patch failed.
-1 javac 27 root in the patch failed.
-1 mvnsite 27 root in the patch failed.
-1 whitespace 0 The patch 1 line(s) with tabs.
+1 xml 8 The patch has no ill-formed XML file.
+1 shadedclient 774 patch has no errors when building and testing our client artifacts.
-1 javadoc 30 root in the patch failed.
_ Other Tests _
-1 unit 31 root in the patch failed.
+1 asflicense 44 The patch does not generate ASF License warnings.
6246
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/Dockerfile
GITHUB PR #1435
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux 5504c393c11c 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / 4852a90
Default Java 1.8.0_222
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/branch-mvnsite-root.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/branch-javadoc-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-mvninstall-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-mvninstall-hadoop-hdds.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-mvninstall-hadoop-hdds_build-tools.txt
compile https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-compile-root.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-compile-root.txt
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-mvnsite-root.txt
whitespace https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/whitespace-tabs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-javadoc-root.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/testReport/
Max. process+thread count 412 (vs. ulimit of 5500)
modules C: . hadoop-hdds hadoop-hdds/build-tools U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/2/console
versions git=2.7.4 maven=3.3.9
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@nandakumar131
Copy link
Contributor Author

/retest

@elek
Copy link
Member

elek commented Sep 14, 2019

Thanks @nandakumar131 the patch. Unfortunately it seems to be failing for me with testing it with the checkstyle.sh.

Until now the checkstyle.sh did a mvn checkstyle:check without compilation (which made it very fast). But now you should have the build-tools compiled and installed to do a full checkstyle check.

I don't know what is the good solution here

  1. We can use file references instead of artifact references to define the checkstyle rule files
  2. Or we can add the required build-tools install to the checkstyle.sh

I liked that it was very fast until know, therefore I would prefer the first one, but there could be other options...

@nandakumar131
Copy link
Contributor Author

Thanks for the suggestion @elek . Modified pom.ozone.xml to use the files from the project instead of maven artifact.

@nandakumar131
Copy link
Contributor Author

Since we are not using maven artifact anymore, we don't need a new maven module hadoop-hdds-build-tools exactly. I'm happy to leave it as it is if we can use this to add more build tools, or else we can remove this module and move the files somewhere else.

See the License for the specific language governing permissions and
limitations under the License.
-->
<xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="1.0">

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:tabs in line

@hadoop-yetus
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 60 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 @author 0 The patch does not contain any @author tags.
-1 test4tests 0 The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ trunk Compile Tests _
0 mvndep 70 Maven dependency ordering for branch
+1 mvninstall 1696 trunk passed
+1 compile 1359 trunk passed
-1 mvnsite 1093 root in trunk failed.
+1 shadedclient 4937 branch has no errors when building and testing our client artifacts.
+1 javadoc 482 trunk passed
_ Patch Compile Tests _
0 mvndep 36 Maven dependency ordering for patch
-1 mvninstall 26 root in the patch failed.
-1 mvninstall 25 hadoop-hdds in the patch failed.
-1 mvninstall 22 build-tools in the patch failed.
-1 compile 28 root in the patch failed.
-1 javac 28 root in the patch failed.
-1 mvnsite 27 root in the patch failed.
-1 whitespace 0 The patch 1 line(s) with tabs.
+1 xml 8 The patch has no ill-formed XML file.
+1 shadedclient 772 patch has no errors when building and testing our client artifacts.
-1 javadoc 30 root in the patch failed.
_ Other Tests _
-1 unit 30 root in the patch failed.
+1 asflicense 46 The patch does not generate ASF License warnings.
6735
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/Dockerfile
GITHUB PR #1435
Optional Tests dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient xml
uname Linux 81b07cd59e9d 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality personality/hadoop.sh
git revision trunk / e04b8a4
Default Java 1.8.0_222
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/branch-mvnsite-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-mvninstall-root.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-mvninstall-hadoop-hdds.txt
mvninstall https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-mvninstall-hadoop-hdds_build-tools.txt
compile https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-compile-root.txt
javac https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-compile-root.txt
mvnsite https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-mvnsite-root.txt
whitespace https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/whitespace-tabs.txt
javadoc https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-javadoc-root.txt
unit https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/artifact/out/patch-unit-root.txt
Test Results https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/testReport/
Max. process+thread count 455 (vs. ulimit of 5500)
modules C: . hadoop-hdds hadoop-hdds/build-tools U: .
Console output https://builds.apache.org/job/hadoop-multibranch/job/PR-1435/3/console
versions git=2.7.4 maven=3.3.9
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@elek
Copy link
Member

elek commented Sep 16, 2019

Thanks @nandakumar131 the update. I would remove the build-tools for now. We can (re)create it when we can see the exact need.

I think we can use hadoop-hdds/dev-support/... to store the checksyle as of now...

@elek
Copy link
Member

elek commented Sep 19, 2019

Currently all the checkstyle checks are showing false negative answers. I will commit this with the suggested change (moving checkstyle XML files to the dev-support) if no objections...

We can improve it (or switch back to the dedicated project) in follow-up jiras, but we need to fix the checks ASAP.

@elek elek closed this in e78848f Sep 19, 2019
@nandakumar131 nandakumar131 deleted the HDDS-2119 branch September 20, 2019 02:48
@nandakumar131
Copy link
Contributor Author

Thanks @elek for taking care of this!

amahussein pushed a commit to amahussein/hadoop that referenced this pull request Oct 29, 2019
RogPodge pushed a commit to RogPodge/hadoop that referenced this pull request Mar 25, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants