Kafka: runtime integration test failure or flaky

[stevenzwu]

Apache Iceberg version

main (development)

Query engine

Kafka Connect

Please describe the bug 🐞

here is an example CI build failure for main branch: https://github.com/apache/iceberg/actions/runs/10618244799/job/29432988040

> Task :iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest

IntegrationDynamicTableTest > testIcebergSink(String) > [1] null FAILED
    java.lang.ExceptionInInitializerError at IntegrationDynamicTableTest.java:38
        Caused by: org.testcontainers.containers.ContainerLaunchException at IntegrationDynamicTableTest.java:38
            Caused by: org.rnorth.ducttape.RetryCountExceededException at IntegrationDynamicTableTest.java:38
                Caused by: org.testcontainers.containers.ContainerLaunchException at IntegrationDynamicTableTest.java:38
                    Caused by: java.lang.IllegalStateException at IntegrationDynamicTableTest.java:38

IntegrationDynamicTableTest > testIcebergSink(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationDynamicTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at IntegrationDynamicTableTest.java:38

IntegrationMultiTableTest > testIcebergSink(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationMultiTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationMultiTableTest > testIcebergSink(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationMultiTableTest.java:38
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkUnpartitionedTable(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkUnpartitionedTable(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkSchemaEvolution(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkSchemaEvolution(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkAutoCreate(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkAutoCreate(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkPartitionedTable(String) > [1] null FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359

IntegrationTest > testIcebergSinkPartitionedTable(String) > [2] test_branch FAILED
    java.lang.NoClassDefFoundError at IntegrationTest.java:51
        Caused by: java.lang.ExceptionInInitializerError at GenericContainer.java:359


> Task :iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest FAILED
12 tests completed, 12 failed

FAILURE: Build failed with an exception.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.


You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
* What went wrong:

Execution failed for task ':iceberg-kafka-connect:iceberg-kafka-connect-runtime:integrationTest'.

Willingness to contribute

• I can contribute a fix for this bug independently
• I would be willing to contribute a fix for this bug with guidance from the Iceberg community
• I cannot contribute a fix for this bug at this time

[stevenzwu]

cc @bryanck

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.