Skip to content

HDDS-2106. Avoid usage of hadoop projects as parent of hdds/ozone #1423

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from

Conversation

elek
Copy link
Member

@elek elek commented Sep 10, 2019

Ozone uses hadoop as a dependency. The dependency defined on multiple level:

  1. the hadoop artifacts are defined in the sections
  2. both hadoop-ozone and hadoop-hdds projects uses "hadoop-project" as the parent

As we already have a slightly different assembly process it could be more resilient to use a dedicated parent project instead of the hadoop one. With this approach it will be easier to upgrade the versions as we don't need to be careful about the pom contents only about the used dependencies.

See: https://issues.apache.org/jira/browse/HDDS-2106

@elek elek added the ozone label Sep 10, 2019
@arp7 arp7 self-requested a review September 11, 2019 17:13
Copy link
Contributor

@arp7 arp7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 LGTM.

Thanks for taking care of this @elek

Copy link
Contributor

@adoroszlai adoroszlai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @elek for raising and addressing this issue.

Just a minor issue: version info is missing for two plugins. Can you please include these in pom.ozone.xml?

[WARNING] Some problems were encountered while building the effective model for org.apache.hadoop:hadoop-hdds-client:jar:0.5.0-SNAPSHOT
[WARNING] 'build.plugins.plugin.version' for org.apache.rat:apache-rat-plugin is missing. @ org.apache.hadoop:hadoop-hdds:0.5.0-SNAPSHOT, /workdir/hadoop-hdds/pom.xml, line 284, column 15
[WARNING] 'build.plugins.plugin.version' for org.apache.maven.plugins:maven-enforcer-plugin is missing. @ org.apache.hadoop:hadoop-hdds:0.5.0-SNAPSHOT, /workdir/hadoop-hdds/pom.xml, line 268, column 15

Copy link
Contributor

@arp7 arp7 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 for the updated patch.

@elek
Copy link
Member Author

elek commented Sep 12, 2019

Thanks @arp7 and @adoroszlai the review. There are no more warnings (missing parts are also migrated from pom.xml) and the integration test failures are not related.

Will merge it soon.

For the records: this is just the first step. As we have this brand new parent pom, later we can simplify the hadoop-ozone/pom.xml and hadoop-hdds/pom.xml as many common parts can be moved to pom.ozone.xml

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants