HADOOP-15983. Use jersey-json that is built to use jackson2

[pjfanning]

Description of PR

Use a jersey-json fork that supports jackson 2. This jar is still a prototype. This PR is experimental and not yet for merging.

How was this patch tested?

For code changes:

• Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
• Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
• If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
• If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

[pjfanning]

@aajisaka when you get a chance, could you review this? I'm not sure if the failing tests are related to the change.

[pjfanning]

@aajisaka there is a still a problem with this change - see https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3988/16/artifact/out/patch-mvninstall-root.txt

[INFO] Apache Hadoop Client Packaging Invariants for Test . FAILURE [  0.824 s]

The issue is this (truncated a bit):

[ERROR] Found artifact with unexpected contents: '/home/jenkins/jenkins-agent/workspace/hadoop-multibranch_PR-3988/ubuntu-focal/src/hadoop-client-modules/hadoop-client-minicluster/target/hadoop-client-minicluster-3.4.0-SNAPSHOT.jar'
    Please check the following and either correct the build or update
    the allowed list with reasoning.

    javax/
    javax/xml/
    javax/xml/bind/
    javax/xml/bind/annotation/
    javax/xml/bind/annotation/adapters/
    javax/xml/bind/annotation/adapters/XmlAdapter.class
    javax/xml/bind/annotation/adapters/XmlJavaTypeAdapters.class
    javax/xml/bind/annotation/adapters/XmlJavaTypeAdapter$DEFAULT.class
    javax/xml/bind/annotation/adapters/XmlJavaTypeAdapter.class
    javax/xml/bind/annotation/adapters/CollapsedStringAdapter.class
    javax/xml/bind/annotation/adapters/HexBinaryAdapter.class
    javax/xml/bind/annotation/adapters/NormalizedStringAdapter.class
    javax/xml/bind/annotation/XmlValue.class
    javax/xml/bind/annotation/XmlRegistry.class
    javax/xml/bind/annotation/XmlElements.class
    javax/xml/bind/annotation/XmlElement$DEFAULT.class
    javax/xml/bind/annotation/XmlElement.class
    javax/xml/bind/annotation/XmlSchema.class
    javax/xml/bind/annotation/XmlNs.class
    javax/xml/bind/annotation/XmlNsForm.class
    javax/xml/bind/annotation/XmlType$DEFAULT.class
    javax/xml/bind/annotation/XmlType.class
    javax/xml/bind/annotation/XmlElementRefs.class
    javax/xml/bind/annotation/XmlElementRef$DEFAULT.class
    javax/xml/bind/annotation/XmlElementRef.class
    javax/xml/bind/annotation/XmlElementDecl$GLOBAL.class
    javax/xml/bind/annotation/XmlElementDecl.class
    javax/xml/bind/annotation/XmlElementWrapper.class
    javax/xml/bind/annotation/DomHandler.class
    javax/xml/bind/annotation/XmlMimeType.class
    javax/xml/bind/annotation/XmlSeeAlso.class
    javax/xml/bind/annotation/W3CDomHandler.class
    javax/xml/bind/annotation/XmlIDREF.class
    javax/xml/bind/annotation/XmlAccessType.class
    javax/xml/bind/annotation/XmlAccessorOrder.class
    javax/xml/bind/annotation/XmlAccessOrder.class
    javax/xml/bind/annotation/XmlAttachmentRef.class
    javax/xml/bind/annotation/XmlAnyElement.class
    javax/xml/bind/annotation/XmlSchemaTypes.class
    javax/xml/bind/annotation/XmlSchemaType$DEFAULT.class
    javax/xml/bind/annotation/XmlSchemaType.class
    javax/xml/bind/annotation/XmlRootElement.class
    javax/xml/bind/annotation/XmlAttribute.class
    javax/xml/bind/annotation/XmlMixed.class
    javax/xml/bind/annotation/XmlAccessorType.class

[EDIT] I think I fixed this with 629399a

[hadoop-yetus]

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 52s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	15m 48s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 5s		trunk passed
+1 💚	compile	25m 1s		trunk passed with JDK Ubuntu-11.0.14.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	compile	21m 31s		trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	28m 22s		trunk passed
+1 💚	javadoc	8m 40s		trunk passed with JDK Ubuntu-11.0.14.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 23s		trunk passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	39m 57s		branch has no errors when building and testing our client artifacts.
-0 ⚠️	patch	40m 14s		Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 39s		Maven dependency ordering for patch
+1 💚	mvninstall	36m 18s		the patch passed
+1 💚	compile	24m 21s		the patch passed with JDK Ubuntu-11.0.14.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javac	24m 21s		the patch passed
+1 💚	compile	21m 29s		the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚	javac	21m 29s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	22m 21s		the patch passed
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	xml	0m 15s		The patch has no ill-formed XML file.
+1 💚	javadoc	8m 23s		the patch passed with JDK Ubuntu-11.0.14.1+1-Ubuntu-0ubuntu1.20.04
+1 💚	javadoc	8m 20s		the patch passed with JDK Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	40m 28s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	985m 5s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	1m 28s		The patch does not generate ASF License warnings.
		1294m 13s

Reason	Tests
Failed junit tests	hadoop.hdfs.rbfbalance.TestRouterDistCpProcedure

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3988/17/artifact/out/Dockerfile
GITHUB PR	#3988
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell xml shellcheck shelldocs
uname	Linux c842fad75d49 4.15.0-162-generic #170-Ubuntu SMP Mon Oct 18 11:38:05 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / 629399a
Default Java	Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.14.1+1-Ubuntu-0ubuntu1.20.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_312-8u312-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3988/17/testReport/
Max. process+thread count	2240 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-common-project/hadoop-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-applicationhistoryservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-catalog/hadoop-yarn-applications-catalog-webapp hadoop-client-modules/hadoop-client hadoop-tools/hadoop-resourceestimator hadoop-client-modules/hadoop-client-minicluster . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-3988/17/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0-SNAPSHOT https://yetus.apache.org

This message was automatically generated.

[pjfanning]

@aajisaka @steveloughran would either of you be able to take a look at this. The test that failed is one that seems to fail regularly anyway. I think I have fixed the other issues. This change would only be targeted at a future 3.4.0 release.

[steveloughran]

this should involve those sub projects who use jersey, to make sure they are all happy.

if it was a random github artifact we'd be reluctant; the fact you are an asf member who could get code into our classpath anyway if you tried hard means this isn't an issue.

would probably need an incompatible entry in the release notes for any maven project excluding/overriding the old one

[pjfanning]

@steveloughran one option would be for me to change the package name in my variant of jersey-json so that other projects that use hadoop and jersey 1 wouldn't be affected. From looking around a bit, many other projects that use hadoop don't use jersey themselves or use jersey 2 in some cases.

[aajisaka]

+1, thank you @pjfanning for your hard work and thank you @steveloughran for reviewing and starting the discussion on the mailing list.

I want to merge this tomorrow if there is no objection.

[pjfanning]

@aajisaka thanks for reviewing this - if there are any issues post-merge, I will have a look

[aajisaka]

Merged into trunk. Thank you @pjfanning and @steveloughran