Skip to content

Conversation

@jiayuasu
Copy link
Member

@jiayuasu jiayuasu commented Nov 16, 2025

Did you read the Contributor Guide?

Is this PR related to a ticket?

What changes were proposed in this PR?

This pull request updates the Flink and Java Spark SQL example projects by modernizing dependencies, improving test coverage, cleaning up code, and enhancing build and CI configurations. Key changes include upgrading Spark and Sedona, refactoring the Flink example and utilities, adding Flink unit tests, and tightening Maven and CI setups.

Dependency and Configuration Updates
• Upgraded Spark, Sedona, Scala, and JUnit in the Java Spark SQL example and added Java 17+ compatibility settings.
• Switched dependency artifacts to use variables for better compatibility.

Flink Refactoring
• Cleaned up FlinkExample.java and Utils.java for clearer structure and extracted core logic into a testable method.

Testing
• Added FlinkFunctionsTest.java to validate S2 spatial joins across dataset sizes.

Build and Formatting
• Set Flink dependencies to provided and added Spotless and Surefire plugins for formatting and test execution.

CI Workflow
• Updated the example workflow to use mvn test, removed unused Java options, improved job naming, and split testing for Java, Scala, and Flink examples.

How was this patch tested?

Did this PR include necessary documentation updates?

  • No, this PR does not affect any public API so no need to change the documentation.

@jiayuasu jiayuasu marked this pull request as ready for review November 16, 2025 07:28
@jiayuasu jiayuasu merged commit 3d1ebde into master Nov 16, 2025
12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update the example projects to include more examples

1 participant