[SPARK-49872][CORE] Remove jackson JSON string length limitation : https://github.corp.ebay.com/carmel/ebay-spark/pull/863 (apache#22)

This is a surgical fix extracted from
apache#49163

The default jackson string limit introduced in jackson 2.15 can be too
small for certain workloads, and this PR removes this limitation to
avoid any regression.

fix regression

Yes, users won't hit this size limitation anymore.

apache#49163 tested it. We won't add a
test in this PR as generating a super large JSON will make the CI
unstable.

no

Closes apache#52049 from cloud-fan/json.

Lead-authored-by: Wenchen Fan <wenchen@databricks.com>


(cherry picked from commit 076618a)

Signed-off-by: Wenchen Fan <wenchen@databricks.com>
Co-authored-by: Wenchen Fan <wenchen@databricks.com>
Co-authored-by: Wenchen Fan <cloud0fan@gmail.com>

Author: 2 people

core/src/main/scala/org/apache/spark/util/JsonProtocol.scala

@@ -22,7 +22,7 @@ import java.util.{Properties, UUID}
 import scala.collection.JavaConverters._
 import scala.collection.Map
 
-import com.fasterxml.jackson.core.JsonGenerator
+import com.fasterxml.jackson.core.{JsonGenerator, StreamReadConstraints}
 import com.fasterxml.jackson.databind.JsonNode
 import org.json4s.jackson.JsonMethods.compact
 
@@ -54,6 +54,11 @@ import org.apache.spark.util.Utils.weakIntern
 private[spark] object JsonProtocol extends JsonUtils {
   // TODO: Remove this file and put JSON serialization into each individual class.
 
+  // SPARK-49872: Remove jackson JSON string length limitation.
+  mapper.getFactory.setStreamReadConstraints(
+    StreamReadConstraints.builder().maxStringLength(Int.MaxValue).build()
+  )
+
   /** ------------------------------------------------- *
    * JSON serialization methods for SparkListenerEvents |
    * -------------------------------------------------- */