Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug report] Doris table operation integration test failed occasionally #3317

Closed
FANNG1 opened this issue May 10, 2024 · 5 comments
Closed
Labels
0.6.0 Release v0.6.0 bug Something isn't working

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented May 10, 2024

Version

PR: #3307

Describe what's wrong

doris table operation failed in ci occasionally, seems the state of doris is not healthy.

Failed ci: https://github.com/datastrato/gravitino/actions/runs/9025764657/job/24801995236.

Error message and/or stacktrace

DorisTableOperationsIT > testAlterTable() FAILED
    com.datastrato.gravitino.exceptions.GravitinoRuntimeException: errCode = 2, detailMessage = Table[doris_alter_test_table_9de02715]'s state is not NORMAL. Do not allow doing ALTER ops
        at app//com.datastrato.gravitino.catalog.doris.converter.DorisExceptionConverter.toGravitinoException(DorisExceptionConverter.java:66)
        at app//com.datastrato.gravitino.catalog.jdbc.operation.JdbcTableOperations.alterTable(JdbcTableOperations.java:247)
        at app//com.datastrato.gravitino.catalog.doris.integration.test.DorisTableOperationsIT.testAlterTable(DorisTableOperationsIT.java:184)

        Caused by:
        java.sql.SQLException: errCode = 2, detailMessage = Table[doris_alter_test_table_9de02715]'s state is not NORMAL. Do not allow doing ALTER ops
            at com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:129)
            at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122)
            at com.mysql.cj.jdbc.StatementImpl.executeUpdateInternal(StatementImpl.java:1333)
            at com.mysql.cj.jdbc.StatementImpl.executeLargeUpdate(StatementImpl.java:2106)
            at com.mysql.cj.jdbc.StatementImpl.executeUpdate(StatementImpl.java:1243)
            at org.apache.commons.dbcp2.DelegatingStatement.executeUpdate(DelegatingStatement.java:330)
            at org.apache.commons.dbcp2.DelegatingStatement.executeUpdate(DelegatingStatement.java:330)
            at com.datastrato.gravitino.catalog.jdbc.utils.JdbcConnectorUtils.executeUpdate(JdbcConnectorUtils.java:28)
            at com.datastrato.gravitino.catalog.jdbc.operation.JdbcTableOperations.alterTable(JdbcTableOperations.java:244)

How to reproduce

CI

Additional context

No response

@FANNG1 FANNG1 added the bug Something isn't working label May 10, 2024
@FANNG1 FANNG1 changed the title [Bug report] Doris table operation integration test failed [Bug report] Doris table operation integration test failed occasionally May 10, 2024
@FANNG1
Copy link
Contributor Author

FANNG1 commented May 10, 2024

seems couldn't reproduce on main branch, but easy to reproduce on PR: #3307

@yuqi1129
Copy link
Contributor

This bug is a known bug that occasionally occurs, but not frequently. The core reason is that alter operation in Doris is asynchronous and increasing the wait time will alleviate the problem, but it can't completely eliminate it.
The following are related similar cases:
https://github.com/datastrato/gravitino/actions/runs/9013450467/job/24764301966?pr=3100
https://github.com/datastrato/gravitino/actions/runs/9013889875/job/24765516186

@FANNG1
Copy link
Contributor Author

FANNG1 commented May 10, 2024

seems not the same problem, the problem you mentioned is alter operation does not takes affect. but in this case, alter operation is not allowed for state is not NORMAL

@zhoukangcn
Copy link
Contributor

zhoukangcn commented May 10, 2024

Maybe it's a bug of Doris 1.2.7, in some cases, the Doris tablet is damaged.

I will track this issue.

@yuqi1129
Copy link
Contributor

yuqi1129 commented Aug 1, 2024

This issue has been temporarily resolved by increasing the wait time, so we will close it.

@yuqi1129 yuqi1129 closed this as completed Aug 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.6.0 Release v0.6.0 bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants