[SPARK-55706][SQL][TESTS] Disable DB2 JDBC Driver tests by dongjoon-hyun · Pull Request #54505 · apache/spark

dongjoon-hyun · 2026-02-26T07:14:42Z

What changes were proposed in this pull request?

This PR aims to disable DB2 JDBC driver test coverage until it removes its side-effect.

ConnectionProviderSuite is revised to use another connection provider instead of DB2.
SPARK-55707 is filed to re-enable the disabled tests.

Why are the changes needed?

To avoid a side-effect on LZ4 test dependency. We had better focus on the non-test dependency first.

Does this PR introduce any user-facing change?

No Spark's behavior change because this is only a test dependency and coverage.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

dongjoon-hyun · 2026-02-26T07:15:45Z

cc @pan3793 and @LuciferYang

pan3793 · 2026-02-26T07:19:47Z

@dongjoon-hyun thanks, I rebased #53454 on this one, let's wait for the CI result. I think it should pass.

dongjoon-hyun · 2026-02-26T07:21:31Z

Thank you.

dongjoon-hyun · 2026-02-26T07:33:44Z

Oops. I missed to run docker-integration-tests. Let me verify more.

dongjoon-hyun · 2026-02-26T07:49:06Z

$ build/sbt -Pdocker-integration-tests "docker-integration-tests/testOnly *DB2*Suite"
...
[info] DB2IntegrationSuite:
[info] - SPARK-52184: Wrap external engine syntax error !!! IGNORED !!!
[info] - SPARK-53386: Parameter `query` should work when ending with semicolons !!! IGNORED !!!
[info] - Basic test !!! IGNORED !!!
[info] - Numeric types !!! IGNORED !!!
[info] - Date types !!! IGNORED !!!
[info] - String types !!! IGNORED !!!
[info] - Basic write test !!! IGNORED !!!
[info] - query JDBC option !!! IGNORED !!!
[info] - SPARK-30062 !!! IGNORED !!!
[info] - SPARK-42534: DB2 Limit pushdown test !!! IGNORED !!!
[info] - SPARK-48269: boolean type !!! IGNORED !!!
[info] - SPARK-48269: GRAPHIC types !!! IGNORED !!!
[info] - SPARK-48269: binary types !!! IGNORED !!!
[info] DB2IntegrationSuite:
[info] - SPARK-33034: ALTER TABLE ... add new columns !!! IGNORED !!!
[info] - SPARK-33034: ALTER TABLE ... drop column !!! IGNORED !!!
[info] - SPARK-33034: ALTER TABLE ... update column type !!! IGNORED !!!
[info] - SPARK-33034: ALTER TABLE ... rename column !!! IGNORED !!!
[info] - SPARK-33034: ALTER TABLE ... update column nullability !!! IGNORED !!!
[info] - CREATE TABLE with table comment !!! IGNORED !!!
[info] - CREATE TABLE with table property !!! IGNORED !!!
[info] - SPARK-36895: Test INDEX Using SQL !!! IGNORED !!!
[info] - SPARK-48172: Test CONTAINS !!! IGNORED !!!
[info] - SPARK-48172: Test ENDSWITH !!! IGNORED !!!
[info] - SPARK-48172: Test STARTSWITH !!! IGNORED !!!
[info] - SPARK-48172: Test LIKE !!! IGNORED !!!
[info] - SPARK-37038: Test TABLESAMPLE (true) !!! IGNORED !!!
[info] - SPARK-37038: Test TABLESAMPLE (false) !!! IGNORED !!!
[info] - simple scan (true) !!! IGNORED !!!
[info] - simple scan (false) !!! IGNORED !!!
[info] - simple scan with LIMIT (true) !!! IGNORED !!!
[info] - simple scan with LIMIT (false) !!! IGNORED !!!
[info] - simple scan with top N (true) !!! IGNORED !!!
[info] - simple scan with top N (false) !!! IGNORED !!!
[info] - simple scan with OFFSET (true) !!! IGNORED !!!
[info] - simple scan with OFFSET (false) !!! IGNORED !!!
[info] - simple scan with LIMIT and OFFSET (true) !!! IGNORED !!!
[info] - simple scan with LIMIT and OFFSET (false) !!! IGNORED !!!
[info] - simple scan with paging: top N and OFFSET (true) !!! IGNORED !!!
[info] - simple scan with paging: top N and OFFSET (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_POP with DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_POP with DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_SAMP with DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_SAMP with DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_POP with DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_POP with DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_SAMP with DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_SAMP with DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_POP with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_POP with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_SAMP with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_SAMP with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: CORR with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: CORR with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_INTERCEPT with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_INTERCEPT with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SLOPE with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SLOPE with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_R2 with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_R2 with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SXY with DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SXY with DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_POP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_POP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_SAMP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: VAR_SAMP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_POP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_POP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_SAMP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: STDDEV_SAMP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_POP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_POP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_SAMP without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: COVAR_SAMP without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: CORR without DISTINCT (true) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: CORR without DISTINCT (false) (excluded) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_INTERCEPT without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_INTERCEPT without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SLOPE without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SLOPE without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_R2 without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_R2 without DISTINCT (false) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SXY without DISTINCT (true) !!! IGNORED !!!
[info] - scan with aggregate push-down: REGR_SXY without DISTINCT (false) !!! IGNORED !!!
[info] - SPARK-48618: Renaming the table to the name of an existing table !!! IGNORED !!!
[info] - SPARK-48618: Test table does not exists error !!! IGNORED !!!
[info] - scan with filter push-down with date time functions !!! IGNORED !!!
[info] - SPARK-50792: Format binary data as a binary literal in JDBC. !!! IGNORED !!!
[info] - SPARK-52262: FAILED_JDBC.TABLE_EXISTS not thrown on connection error !!! IGNORED !!!
[info] DB2NamespaceSuite:
[info] - listNamespaces: basic behavior !!! IGNORED !!!
[info] - Drop namespace !!! IGNORED !!!
[info] DB2KrbIntegrationSuite:
[info] - Basic read test in query option !!! IGNORED !!!
[info] - Basic read test in create table path !!! IGNORED !!!
[info] - Basic write test !!! IGNORED !!!
[info] - SPARK-35226: JDBCOption should accept refreshKrb5Config parameter !!! IGNORED !!!
[info] Run completed in 958 milliseconds.
[info] Total number of tests run: 0
[info] Suites: completed 4, aborted 0
[info] Tests: succeeded 0, failed 0, canceled 0, ignored 94, pending 0
[info] No tests were executed.
[success] Total time: 14 s, completed Feb 25, 2026, 11:48:08 PM

.../docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DB2IntegrationSuite.scala

...cker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/DB2IntegrationSuite.scala

dongjoon-hyun · 2026-02-26T08:08:38Z

Since it's too late for me in Cupertino, I'll check the CI result tomorrow morninn. i'll ping you nex time adter the PR passes the CI. Sorry for the trouble.

pan3793 · 2026-02-26T08:10:43Z

@dongjoon-hyun thank you, I will keep eyes here.

pan3793 · 2026-02-26T10:13:57Z

thanks, merging to master

dongjoon-hyun changed the title ~~[SPARK-55706] Disable DB2 JDBC Driver tests~~ [SPARK-55706][SQL][TESTS] Disable DB2 JDBC Driver tests Feb 26, 2026

dongjoon-hyun mentioned this pull request Feb 26, 2026

[SPARK-55136][BUILD] Bump Db2 JDBC driver 12.1.3.0_special_74723 #53920

Closed

LuciferYang approved these changes Feb 26, 2026

View reviewed changes

dongjoon-hyun marked this pull request as draft February 26, 2026 07:33

dongjoon-hyun force-pushed the SPARK-55706 branch from 04e8553 to 41078b4 Compare February 26, 2026 07:35

dongjoon-hyun marked this pull request as ready for review February 26, 2026 07:35

dongjoon-hyun marked this pull request as draft February 26, 2026 07:43

[SPARK-55706] Disable DB2 JDBC Driver tests

37eaf37

dongjoon-hyun force-pushed the SPARK-55706 branch from 41078b4 to 37eaf37 Compare February 26, 2026 07:49

dongjoon-hyun marked this pull request as ready for review February 26, 2026 07:49

pan3793 reviewed Feb 26, 2026

View reviewed changes

.../docker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/DB2IntegrationSuite.scala Show resolved Hide resolved

dongjoon-hyun commented Feb 26, 2026

View reviewed changes

...cker-integration-tests/src/test/scala/org/apache/spark/sql/jdbc/v2/DB2IntegrationSuite.scala Show resolved Hide resolved

pan3793 closed this in 811c3fa Feb 26, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[SPARK-55706][SQL][TESTS] Disable DB2 JDBC Driver tests#54505

[SPARK-55706][SQL][TESTS] Disable DB2 JDBC Driver tests#54505
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-55706

dongjoon-hyun commented Feb 26, 2026 •

edited

Loading

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

Uh oh!

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

dongjoon-hyun commented Feb 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

Uh oh!

Uh oh!

dongjoon-hyun commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

pan3793 commented Feb 26, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

dongjoon-hyun commented Feb 26, 2026 •

edited

Loading