[AUTOCUT] Integration Test Failed for sql-3.2.0

[opensearch-ci-bot]

Integration Test Failed for version 3.2.0. See the specifications below:

Details

Platform	Dist	Arch	Dist Build No.	RC	Test Report	Workflow Run	Failing tests
linux	rpm	x64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/x64/rpm/test-results/10262/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10262/display/redirect	Check metrics
linux	deb	arm64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/arm64/deb/test-results/10261/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10261/display/redirect	Check metrics
linux	tar	x64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/x64/tar/test-results/10260/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10260/display/redirect	Check metrics
linux	tar	arm64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/arm64/tar/test-results/10258/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10258/display/redirect	Check metrics
linux	deb	x64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/x64/deb/test-results/10263/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10263/display/redirect	Check metrics
linux	rpm	arm64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/linux/arm64/rpm/test-results/10259/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10259/display/redirect	Check metrics
windows	zip	x64	11325	3	https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11325/windows/x64/zip/test-results/10264/integ-test/test-report.yml	https://build.ci.opensearch.org/job/integ-test/10264/display/redirect	Check metrics

Check out test report manifest linked above for steps to reproduce, cluster and integration test failure logs. For additional information checkout the wiki and OpenSearch Metrics Dashboard.

Tagging the release owners to take a look @dai-chen @mengweieric

[opensearch-ci-bot]

Closing the issue as the integration tests for sql passed for version: 3.2.0.

[dai-chen]

  - name: sql
    command: ./test.sh integ-test manifests/3.2.0/opensearch-3.2.0-test.yml --paths
      opensearch=https://ci.opensearch.org/ci/dbc/distribution-build-opensearch/3.2.0/11323/linux/arm64/tar
      --component sql
    repository: https://github.com/opensearch-project/sql.git
    configs:
      - name: with-security
        status: FAIL
        yml: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/with-security/sql.yml
        test_stdout: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/with-security/stdout.txt
        test_stderr: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/with-security/stderr.txt
        cluster_stdout:
          - https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/with-security/local-cluster-logs/id-0/stdout.txt
        cluster_stderr:
          - https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/with-security/local-cluster-logs/id-0/stderr.txt
        failed_test:
          - org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT#failWhenNumOfColumnsNotMatchOutputOfSubquery
          - org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT#failWhenNumOfColumnsNotMatchOutputOfSubquery
      - name: without-security
        status: FAIL
        yml: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/without-security/sql.yml
        test_stdout: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/without-security/stdout.txt
        test_stderr: https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/without-security/stderr.txt
        cluster_stdout:
          - https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/without-security/local-cluster-logs/id-1/stdout.txt
        cluster_stderr:
          - https://ci.opensearch.org/ci/dbc/integ-test/3.2.0/11323/linux/arm64/tar/test-results/10248/integ-test/sql/without-security/local-cluster-logs/id-1/stderr.txt
        failed_test:
          - org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT#failWhenNumOfColumnsNotMatchOutputOfSubquery
          - org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT#failWhenNumOfColumnsNotMatchOutputOfSubquery

[dai-chen]

No expected ResponseException thrown. Not sure if this is flaky and will be gone after rerun. cc: @yuancu

Suite: Test class org.opensearch.sql.calcite.CalciteNoPushdownIT

  2> REPRODUCE WITH: ./gradlew ':integ-test:integTest' --tests 'org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT.failWhenNumOfColumnsNotMatchOutputOfSubquery' -Dtests.seed=ABF2A99728337823 -Dtests.security.manager=false -Dtests.locale=mgo-CM -Dtests.timezone=Pacific/Efate -Druntime.java=24

  2> java.lang.AssertionError: expected org.opensearch.client.ResponseException to be thrown, but nothing was thrown

        at __randomizedtesting.SeedInfo.seed([ABF2A99728337823:33956C36803BAEB6]:0)

        at org.junit.Assert.assertThrows(Assert.java:1028)

        at org.junit.Assert.assertThrows(Assert.java:981)

        at org.opensearch.sql.ppl.PPLIntegTestCase.assertThrowsWithReplace(PPLIntegTestCase.java:238)

        at org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT.failWhenNumOfColumnsNotMatchOutputOfSubquery(CalcitePPLInSubqueryIT.java:321)

  2> NOTE: leaving temporary files on disk at: /tmp/tmpje9oono_/sql/integ-test/build/testrun/integTest/temp/org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT_ABF2A99728337823-001

  2> NOTE: test params are: codec=Asserting(Lucene101): {}, docValues:{}, maxPointsInLeafNode=2008, maxMBSortInHeap=6.325393158935151, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=mgo-CM, timezone=Pacific/Efate

  2> NOTE: Linux 6.1.140-154.222.amzn2023.aarch64 aarch64/Eclipse Adoptium 24.0.1 (64-bit)/cpus=4,threads=1,free=213526128,total=536870912

  2> NOTE: All tests run in this JVM: [AsyncQueryIT, CalciteArrayFunctionIT, CalciteConvertTZFunctionIT, CalciteCsvFormatIT, CalciteDataTypeIT, CalciteDateTimeComparisonIT, CalciteDateTimeFunctionIT, CalciteDateTimeImplementationIT, CalciteDedupCommandIT, CalciteDescribeCommandIT, CalciteExpandCommandIT, CalciteExplainIT, CalciteFieldsCommandIT, CalciteFillNullCommandIT, CalciteFlattenCommandIT, CalciteFlattenDocValueIT, CalciteGeoIpFunctionsIT, CalciteGeoPointFormatsIT, CalciteHeadCommandIT, CalciteIPComparisonIT, CalciteIPFunctionsIT, CalciteLegacyAPICompatibilityIT, CalciteLikeQueryIT, CalciteMathematicalFunctionIT, CalciteNewAddedCommandsIT, CalciteNowLikeFunctionIT, CalciteObjectFieldOperateIT, CalciteOperatorIT, CalciteParseCommandIT, CalcitePPLAggregationIT, CalcitePPLAppendcolIT, CalcitePPLBasicIT, CalcitePPLBuiltinDatetimeFunctionInvalidIT, CalcitePPLBuiltinFunctionIT, CalcitePPLBuiltinFunctionsNullIT, CalcitePPLCaseFunctionIT, CalcitePPLCastFunctionIT, CalcitePPLConditionBuiltinFunctionIT, CalcitePPLCryptographicFunctionIT, CalcitePPLDedupIT, CalcitePPLEventstatsIT, CalcitePPLExistsSubqueryIT, CalcitePPLExplainIT, CalcitePPLFillnullIT, CalcitePPLGrokIT, CalcitePPLInSubqueryIT]



REPRODUCE WITH: ./gradlew ':integ-test:integTest' --tests 'org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT.failWhenNumOfColumnsNotMatchOutputOfSubquery' -Dtests.seed=ABF2A99728337823 -Dtests.security.manager=false -Dtests.locale=mgo-CM -Dtests.timezone=Pacific/Efate -Druntime.java=24





Suite: Test class org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT

  2> REPRODUCE WITH: ./gradlew ':integ-test:integTest' --tests 'org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT.failWhenNumOfColumnsNotMatchOutputOfSubquery' -Dtests.seed=ABF2A99728337823 -Dtests.security.manager=false -Dtests.locale=mgo-CM -Dtests.timezone=Pacific/Efate -Druntime.java=24

  2> java.lang.AssertionError: expected org.opensearch.client.ResponseException to be thrown, but nothing was thrown

        at __randomizedtesting.SeedInfo.seed([ABF2A99728337823:33956C36803BAEB6]:0)

        at org.junit.Assert.assertThrows(Assert.java:1028)

        at org.junit.Assert.assertThrows(Assert.java:981)

        at org.opensearch.sql.ppl.PPLIntegTestCase.assertThrowsWithReplace(PPLIntegTestCase.java:238)

        at org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT.failWhenNumOfColumnsNotMatchOutputOfSubquery(CalcitePPLInSubqueryIT.java:321)

  2> NOTE: leaving temporary files on disk at: /tmp/tmpje9oono_/sql/integ-test/build/testrun/integTest/temp/org.opensearch.sql.calcite.remote.CalcitePPLInSubqueryIT_ABF2A99728337823-002

  2> NOTE: test params are: codec=Asserting(Lucene101): {}, docValues:{}, maxPointsInLeafNode=2008, maxMBSortInHeap=6.325393158935151, sim=Asserting(RandomSimilarity(queryNorm=false): {}), locale=mgo-CM, timezone=Pacific/Efate

  2> NOTE: Linux 6.1.140-154.222.amzn2023.aarch64 aarch64/Eclipse Adoptium 24.0.1 (64-bit)/cpus=4,threads=1,free=241049080,total=536870912

  2> NOTE: All tests run in this JVM: [AsyncQueryIT, CalciteArrayFunctionIT, CalciteConvertTZFunctionIT, CalciteCsvFormatIT, CalciteDataTypeIT, CalciteDateTimeComparisonIT, CalciteDateTimeFunctionIT, CalciteDateTimeImplementationIT, CalciteDedupCommandIT, CalciteDescribeCommandIT, CalciteExpandCommandIT, CalciteExplainIT, CalciteFieldsCommandIT, CalciteFillNullCommandIT, CalciteFlattenCommandIT, CalciteFlattenDocValueIT, CalciteGeoIpFunctionsIT, CalciteGeoPointFormatsIT, CalciteHeadCommandIT, CalciteIPComparisonIT, CalciteIPFunctionsIT, CalciteLegacyAPICompatibilityIT, CalciteLikeQueryIT, CalciteMathematicalFunctionIT, CalciteNewAddedCommandsIT, CalciteNowLikeFunctionIT, CalciteObjectFieldOperateIT, CalciteOperatorIT, CalciteParseCommandIT, CalcitePPLAggregationIT, CalcitePPLAppendcolIT, CalcitePPLBasicIT, CalcitePPLBuiltinDatetimeFunctionInvalidIT, CalcitePPLBuiltinFunctionIT, CalcitePPLBuiltinFunctionsNullIT, CalcitePPLCaseFunctionIT, CalcitePPLCastFunctionIT, CalcitePPLConditionBuiltinFunctionIT, CalcitePPLCryptographicFunctionIT, CalcitePPLDedupIT, CalcitePPLEventstatsIT, CalcitePPLExistsSubqueryIT, CalcitePPLExplainIT, CalcitePPLFillnullIT, CalcitePPLGrokIT, CalcitePPLInSubqueryIT, CalcitePPLIPFunctionIT, CalcitePPLJoinIT, CalcitePPLJsonBuiltinFunctionIT, CalcitePPLLookupIT, CalcitePPLParseIT, CalcitePPLPatternsIT, CalcitePPLPluginIT, CalcitePPLRenameIT, CalcitePPLScalarSubqueryIT, CalcitePPLSortIT, CalcitePPLStringBuiltinFunctionIT, CalcitePPLTrendlineIT, CalciteQueryAnalysisIT, CalciteRareCommandIT, CalciteRenameCommandIT, CalciteResourceMonitorIT, CalciteSearchCommandIT, CalciteSettingsIT, CalciteSortCommandIT, CalciteStatsCommandIT, CalciteSystemFunctionIT, CalciteTextFunctionIT, CalciteTopCommandIT, CalciteTrendlineCommandIT, CalciteVisualizationFormatIT, CalciteWhereCommandIT, CalcitePPLTpchIT, CalcitePPLBig5IT, PPLBig5IT, CalcitePPLClickBenchIT, PPLClickBenchIT, CalciteArrayFunctionIT, CalciteConvertTZFunctionIT, CalciteCsvFormatIT, CalciteDataTypeIT, CalciteDateTimeComparisonIT, CalciteDateTimeFunctionIT, CalciteDateTimeImplementationIT, CalciteDedupCommandIT, CalciteDescribeCommandIT, CalciteExpandCommandIT, CalciteExplainIT, CalciteFieldsCommandIT, CalciteFillNullCommandIT, CalciteFlattenCommandIT, CalciteFlattenDocValueIT, CalciteGeoIpFunctionsIT, CalciteGeoPointFormatsIT, CalciteHeadCommandIT, CalciteIPComparisonIT, CalciteIPFunctionsIT, CalciteLegacyAPICompatibilityIT, CalciteLikeQueryIT, CalciteMatchBoolPrefixIT, CalciteMatchIT, CalciteMatchPhraseIT, CalciteMatchPhrasePrefixIT, CalciteMathematicalFunctionIT, CalciteMultiMatchIT, CalciteNewAddedCommandsIT, CalciteNowLikeFunctionIT, CalciteObjectFieldOperateIT, CalciteOperatorIT, CalcitePPLAggregationIT, CalcitePPLAppendcolIT, CalcitePPLBasicIT, CalcitePPLBuiltinDatetimeFunctionInvalidIT, CalcitePPLBuiltinFunctionIT, CalcitePPLBuiltinFunctionsNullIT, CalcitePPLCaseFunctionIT, CalcitePPLCastFunctionIT, CalcitePPLConditionBuiltinFunctionIT, CalcitePPLCryptographicFunctionIT, CalcitePPLDedupIT, CalcitePPLEventstatsIT, CalcitePPLExistsSubqueryIT, CalcitePPLExplainIT, CalcitePPLFillnullIT, CalcitePPLGrokIT, CalcitePPLIPFunctionIT, CalcitePPLInSubqueryIT]

WARNING: A terminally deprecated method in sun.misc.Unsafe has been called

WARNING: sun.misc.Unsafe::arrayBaseOffset has been called by com.google.protobuf.UnsafeUtil$MemoryAccessor (file:/home/ci-runner/.gradle/caches/modules-2/files-2.1/com.google.protobuf/protobuf-java/3.25.5/5ae5c9ec39930ae9b5a61b32b93288818ec05ec1/protobuf-java-3.25.5.jar)

WARNING: Please consider reporting this to the maintainers of class com.google.protobuf.UnsafeUtil$MemoryAccessor

WARNING: sun.misc.Unsafe::arrayBaseOffset will be removed in a future release



4428 tests completed, 2 failed, 570 skipped

[dai-chen]

I ran the IT multiple times locally but cannot reproduce.

[yuancu]

I cannot reproduce the exception either, neither locally nor on ubuntu 24 with jdk 24 and the same commit. @dai-chen

Checking the logs of the remote cluster for the test in CI artifacts may help. The log of the test cluster is at integ-test/build/testclusters/integTest-0/logs/integTest.log. Yet from the log of the jenkins CI, it seems this file is not uploaded to s3://${ARTIFACT_BUCKET_NAME}/integ-test/3.2.0/11323/linux/arm64/tar. Can you help add this file for debug by altering the jenkins workflow?