Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

There was an error loading the tables - for impala datasource #23850

Open
3 tasks done
VitaliyFedorov opened this issue Apr 27, 2023 · 17 comments · Fixed by cloudera/impyla#511
Open
3 tasks done

There was an error loading the tables - for impala datasource #23850

VitaliyFedorov opened this issue Apr 27, 2023 · 17 comments · Fixed by cloudera/impyla#511
Labels
#bug Bug report data:connect:impala Related to Impala

Comments

@VitaliyFedorov
Copy link

Getting table list is not working while creating dataset and in SQL Lab, got following error:
There was an error loading the tables

How to reproduce the bug

  1. Go to 'Datasets'

  2. Click on '+ Dataset'

  3. Choose impala datasource

  4. Choose schema

  5. See error: There was an error loading the tables

  6. Go to 'SQL' -> 'SQL Lab'

  7. Choose impala datasource

  8. Choose schema

  9. See error: There was an error loading the tables

Expected results

List of tables are seen in at SEE TABLE SCHEMA field

Actual results

Nothing happens and error message appear at UI

Screenshots

Screenshot_7

Environment

  • browser type and version: Google-Chrome 108.0.5359.72
  • superset version: 2.1.0
  • python version: Python 3.8.12
  • impyla version: 0.18.0
  • thrift version: 0.16.0
  • any feature flags active:
"DASHBOARD_RBAC": True,
"ENABLE_TEMPLATE_PROCESSING": True,
"DASHBOARD_NATIVE_FILTERS": True,
"DASHBOARD_CROSS_FILTERS": True,
"ALERT_REPORTS": True,
"THUMBNAILS": True,
"ENABLE_TEMPLATE_PROCESSING": True,

Checklist

Make sure to follow these steps before submitting your issue - thank you!

  • I have checked the superset logs for python stacktraces and included it here as text if there are any.
  • I have reproduced the issue with at least the latest released version of superset.
  • I have checked the issue tracker for the same issue and I haven't found one similar.

Additional context

Here is logs that I found, but it contains no error:

xxx.xxx.xxx.xxx - - [27/Apr/2023:15:32:36 +0000] "GET /api/v1/me/ HTTP/1.1" 200 242 "https://superset-host:8888/superset/sqllab/" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
xxx.xxx.xxx.xxx - - [27/Apr/2023:15:32:36 +0000] "GET /api/v1/me/ HTTP/1.1" 200 242 "https://superset-host:8888/superset/sqllab/" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"
2023-04-27 15:32:39,110:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some-host:21050 with PLAIN authentication mechanism
2023-04-27 15:32:39,112:DEBUG:impala._thrift_api:get_socket: host=some-host port=21050 use_ssl=True ca_cert=/certs/ca.crt
2023-04-27 15:32:39,113:DEBUG:impala.hiveserver2:sock=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faec1eef490>
2023-04-27 15:32:39,114:DEBUG:impala._thrift_api:get_transport: socket=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faec1eef490> host=some-host kerberos_service_name=impala auth_mechanism=PLAIN user=some-user password=fuggetaboutit

2023-04-27 15:32:39,233:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7faec1eefdc0> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7faec1eef1f0> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faec1eef4c0>
2023-04-27 15:32:39,233:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7faec1eefac0>, default_db=some_schema)
2023-04-27 15:32:39,233:DEBUG:impala.hiveserver2:Closing HS2 connection
2023-04-27 15:32:39,233:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faec1eef4c0>
2023-04-27 15:32:39,235:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some-host:21050 with PLAIN authentication mechanism
2023-04-27 15:32:39,236:DEBUG:impala._thrift_api:get_socket: host=some-host port=21050 use_ssl=True ca_cert=/certs/ca.crt
2023-04-27 15:32:39,236:DEBUG:impala.hiveserver2:sock=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faec1eef610>
2023-04-27 15:32:39,237:DEBUG:impala._thrift_api:get_transport: socket=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faec1eef610> host=some-host kerberos_service_name=impala auth_mechanism=PLAIN user=some-user password=fuggetaboutit

2023-04-27 15:32:39,343:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7faec1eef820> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7faec1eef1c0> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faec1eefee0>
2023-04-27 15:32:39,344:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7faec1eef5e0>, default_db=some_schema)
2023-04-27 15:32:39,344:DEBUG:impala.hiveserver2:Getting a cursor (Impala session)
2023-04-27 15:32:39,350:DEBUG:impala.hiveserver2:.cursor(): getting new session_handle
2023-04-27 15:32:39,350:DEBUG:impala.hiveserver2:OpenSession: req=TOpenSessionReq(client_protocol=5, username='superset', password=None, configuration={})
2023-04-27 15:32:39,350:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,350:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:OpenSession: resp=TOpenSessionResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), serverProtocolVersion=5, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xe1\xd1\x9c\x1b\xbcHB\xd8\xa4\x16u<\x7fNxT', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c')), configuration={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BROADCAST_BYTES_LIMIT': '34359738368', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_FILE_FORMAT': 'PARQUET', 'DEFAULT_HINTS_INSERT_STATEMENT': 'NOCLUSTERED', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'SHUFFLE', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DEFAULT_TRANSACTIONAL_TYPE': 'NONE', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_DATA_CACHE': '0', 'DISABLE_HBASE_NUM_ROWS_ESTIMATE': '0', 'DISABLE_HDFS_NUM_ROWS_ESTIMATE': '0', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLED_RUNTIME_FILTER_TYPES': 'ALL', 'ENABLE_CNF_REWRITES': '1', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'FETCH_ROWS_TIMEOUT_MS': '0', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'KUDU_REPLICA_SELECTION': 'CLOSEST_REPLICA', 'KUDU_SNAPSHOT_READ_TIMESTAMP_MICROS': '0', 'MAX_CNF_EXPRS': '1000', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_RESULT_SPOOLING_MEM': '104857600', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MAX_SPILLED_RESULT_SPOOLING_MEM': '1073741824', 'MAX_STATEMENT_LENGTH_BYTES': '16777216', 'MEM_LIMIT': '0', 'MEM_LIMIT_EXECUTORS': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NOW_STRING': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'OPTIMIZE_SIMPLE_LIMIT': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_OBJECT_STORE_SPLIT_SIZE': '268435456', 'PARQUET_PAGE_ROW_COUNT_LIMIT': '', 'PARQUET_READ_PAGE_INDEX': '1', 'PARQUET_READ_STATISTICS': '1', 'PARQUET_TIMESTAMP_TYPE': 'INT96_NANOS', 'PARQUET_WRITE_PAGE_INDEX': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREAGG_BYTES_LIMIT': '-1', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REFRESH_UPDATED_HMS_PARTITIONS': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'SPOOL_QUERY_RESULTS': '0', 'STATEMENT_EXPRESSION_LIMIT': '250000', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some-host:25000'})
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:HiveServer2Cursor(service=<impala.hiveserver2.HS2Service object at 0x7faec1eef5e0>, session_handle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xe1\xd1\x9c\x1b\xbcHB\xd8\xa4\x16u<\x7fNxT', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c')), default_config={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BROADCAST_BYTES_LIMIT': '34359738368', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_FILE_FORMAT': 'PARQUET', 'DEFAULT_HINTS_INSERT_STATEMENT': 'NOCLUSTERED', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'SHUFFLE', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DEFAULT_TRANSACTIONAL_TYPE': 'NONE', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_DATA_CACHE': '0', 'DISABLE_HBASE_NUM_ROWS_ESTIMATE': '0', 'DISABLE_HDFS_NUM_ROWS_ESTIMATE': '0', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLED_RUNTIME_FILTER_TYPES': 'ALL', 'ENABLE_CNF_REWRITES': '1', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'FETCH_ROWS_TIMEOUT_MS': '0', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'KUDU_REPLICA_SELECTION': 'CLOSEST_REPLICA', 'KUDU_SNAPSHOT_READ_TIMESTAMP_MICROS': '0', 'MAX_CNF_EXPRS': '1000', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_RESULT_SPOOLING_MEM': '104857600', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MAX_SPILLED_RESULT_SPOOLING_MEM': '1073741824', 'MAX_STATEMENT_LENGTH_BYTES': '16777216', 'MEM_LIMIT': '0', 'MEM_LIMIT_EXECUTORS': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NOW_STRING': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'OPTIMIZE_SIMPLE_LIMIT': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_OBJECT_STORE_SPLIT_SIZE': '268435456', 'PARQUET_PAGE_ROW_COUNT_LIMIT': '', 'PARQUET_READ_PAGE_INDEX': '1', 'PARQUET_READ_STATISTICS': '1', 'PARQUET_TIMESTAMP_TYPE': 'INT96_NANOS', 'PARQUET_WRITE_PAGE_INDEX': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREAGG_BYTES_LIMIT': '-1', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REFRESH_UPDATED_HMS_PARTITIONS': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'SPOOL_QUERY_RESULTS': '0', 'STATEMENT_EXPRESSION_LIMIT': '250000', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some-host:25000'}, hs2_protocol_version=5)
2023-04-27 15:32:39,353:INFO:impala.hiveserver2:Using database some_schema as default
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:Executing query USE some_schema
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xe1\xd1\x9c\x1b\xbcHB\xd8\xa4\x16u<\x7fNxT', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c')), statement='USE some_schema', confOverlay=None, runAsync=True)
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,353:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,495:DEBUG:impala.hiveserver2:ExecuteStatement: resp=TExecuteStatementResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\xd3\\\xdb\xe1N(C\x87\x00\x00\x00\x00\xf0\xe2\x11\xfa', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2023-04-27 15:32:39,495:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'\xd3\\\xdb\xe1N(C\x87\x00\x00\x00\x00\xf0\xe2\x11\xfa', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2023-04-27 15:32:39,495:DEBUG:impala.hiveserver2:Waiting for query to finish
2023-04-27 15:32:39,495:DEBUG:impala.hiveserver2:GetOperationStatus: req=TGetOperationStatusReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\xd3\\\xdb\xe1N(C\x87\x00\x00\x00\x00\xf0\xe2\x11\xfa', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2023-04-27 15:32:39,496:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,496:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:GetOperationStatus: resp=TGetOperationStatusResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationState=2, sqlState=None, errorCode=None, errorMessage=None, hasResultSet=None)
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:_wait_to_finish: waited 0.0024073123931884766 seconds so far
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:Query finished
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:Executing query SHOW TABLES IN `some_schema`
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'\xd3\\\xdb\xe1N(C\x87\x00\x00\x00\x00\xf0\xe2\x11\xfa', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:CloseOperation: req=TCloseOperationReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\xd3\\\xdb\xe1N(C\x87\x00\x00\x00\x00\xf0\xe2\x11\xfa', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,498:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,501:DEBUG:impala.hiveserver2:CloseOperation: resp=TCloseOperationResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None))
2023-04-27 15:32:39,501:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2023-04-27 15:32:39,502:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xe1\xd1\x9c\x1b\xbcHB\xd8\xa4\x16u<\x7fNxT', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c')), statement='SHOW TABLES IN `some_schema`', confOverlay=None, runAsync=True)
2023-04-27 15:32:39,502:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,502:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:ExecuteStatement: resp=TExecuteStatementResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None))
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None)
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:Waiting for query to finish
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:GetOperationStatus: req=TGetOperationStatusReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None))
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,691:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,693:DEBUG:impala.hiveserver2:GetOperationStatus: resp=TGetOperationStatusResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationState=2, sqlState=None, errorCode=None, errorMessage=None, hasResultSet=None)
2023-04-27 15:32:39,693:DEBUG:impala.hiveserver2:_wait_to_finish: waited 0.002398252487182617 seconds so far
2023-04-27 15:32:39,694:DEBUG:impala.hiveserver2:Query finished
2023-04-27 15:32:39,694:DEBUG:impala.hiveserver2:description=None has_result_set=True => getting schema
2023-04-27 15:32:39,694:DEBUG:impala.hiveserver2:GetResultSetMetadata: req=TGetResultSetMetadataReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None))
2023-04-27 15:32:39,694:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,694:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,696:DEBUG:impala.hiveserver2:GetResultSetMetadata: resp=TGetResultSetMetadataResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), schema=TTableSchema(columns=[TColumnDesc(columnName='name', typeDesc=TTypeDesc(types=[TTypeEntry(primitiveEntry=TPrimitiveTypeEntry(type=7, typeQualifiers=None), arrayEntry=None, mapEntry=None, structEntry=None, unionEntry=None, userDefinedTypeEntry=None)]), position=0, comment=None)]))
2023-04-27 15:32:39,696:DEBUG:impala.hiveserver2:get_result_schema: schema=[('name', 'STRING', None, None, None, None, None)]
2023-04-27 15:32:39,697:DEBUG:impala.hiveserver2:Fetching all result rows
2023-04-27 15:32:39,697:DEBUG:impala.hiveserver2:_ensure_buffer_is_filled: buffer empty and op is active => fetching more data
2023-04-27 15:32:39,697:DEBUG:impala.hiveserver2:FetchResults: req=TFetchResultsReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None), orientation=0, maxRows=10240, fetchType=0)
2023-04-27 15:32:39,697:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,697:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,711:DEBUG:impala.hiveserver2:FetchResults: resp=TFetchResultsResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), hasMoreRows=False, results=TRowSet(startRowOffset=0, rows=[], columns=[TColumn(boolVal=None, byteVal=None, i16Val=None, i32Val=None, i64Val=None, doubleVal=None, stringVal=TStringColumn(values=[b'table1', ..., b'tableN'], nulls=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00'), binaryVal=None)]))
2023-04-27 15:32:39,717:DEBUG:impala.hiveserver2:fetch_results: constructing CBatch
2023-04-27 15:32:39,717:DEBUG:impala.hiveserver2:CBatch: input TRowSet num_cols=1 num_rows=7269 tcols=[TStringColumn(values=[b'tableN', ..., b'tableN+K'], nulls=b'\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00')]
2023-04-27 15:32:39,724:DEBUG:impala.hiveserver2:pop_from_buffer: popping row out of buffer
2023-04-27 15:32:39,731:DEBUG:impala.hiveserver2:_ensure_buffer_is_filled: buffer empty and op is active => fetching more data
2023-04-27 15:32:39,731:DEBUG:impala.hiveserver2:FetchResults: req=TFetchResultsReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None), orientation=0, maxRows=10240, fetchType=0)
2023-04-27 15:32:39,731:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,731:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,733:DEBUG:impala.hiveserver2:FetchResults: resp=TFetchResultsResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), hasMoreRows=False, results=TRowSet(startRowOffset=7269, rows=[], columns=[TColumn(boolVal=None, byteVal=None, i16Val=None, i32Val=None, i64Val=None, doubleVal=None, stringVal=TStringColumn(values=[], nulls=b''), binaryVal=None)]))
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:fetch_results: constructing CBatch
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:CBatch: input TRowSet num_cols=1 num_rows=0 tcols=[TStringColumn(values=[], nulls=b'')]
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:_ensure_buffer_is_filled: no more data to fetch
2023-04-27 15:32:39,734:INFO:impala.hiveserver2:Closing active operation
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:CloseOperation: req=TCloseOperationReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'_\x8d0\xee\xff\x99@r\x00\x00\x00\x00U\xdf\x99\xa1', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c'), operationType=0, hasResultSet=True, modifiedRowCount=None))
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,734:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,738:DEBUG:impala.hiveserver2:CloseOperation: resp=TCloseOperationResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None))
2023-04-27 15:32:39,738:DEBUG:impala.hiveserver2:Closing HiveServer2Cursor
2023-04-27 15:32:39,738:DEBUG:impala.hiveserver2:CloseSession: req=TCloseSessionReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xe1\xd1\x9c\x1b\xbcHB\xd8\xa4\x16u<\x7fNxT', secret=b'\xaf+\x83\x8e\xbc\xa5F\xed\xab\xe3%\xf4\xf7I!c')))
2023-04-27 15:32:39,738:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2023-04-27 15:32:39,739:DEBUG:impala.hiveserver2:Transport opened
2023-04-27 15:32:39,741:DEBUG:impala.hiveserver2:CloseSession: resp=TCloseSessionResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None))
2023-04-27 15:32:39,747:DEBUG:impala.hiveserver2:Closing HS2 connection
2023-04-27 15:32:39,748:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faec1eefee0>
2023-04-27 15:32:39,777:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some-host:21050 with PLAIN authentication mechanism
2023-04-27 15:32:39,777:DEBUG:impala._thrift_api:get_socket: host=some-host port=21050 use_ssl=True ca_cert=/certs/ca.crt
2023-04-27 15:32:39,778:DEBUG:impala.hiveserver2:sock=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faedc480400>
2023-04-27 15:32:39,778:DEBUG:impala._thrift_api:get_transport: socket=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faedc480400> host=some-host kerberos_service_name=impala auth_mechanism=PLAIN user=some-user password=fuggetaboutit

2023-04-27 15:32:39,874:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7faedc480430> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7faedc480a60> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faedc480460>
2023-04-27 15:32:39,875:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7faedc480c10>, default_db=some_schema)
2023-04-27 15:32:39,875:DEBUG:impala.hiveserver2:Closing HS2 connection
2023-04-27 15:32:39,876:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faedc480460>
2023-04-27 15:32:39,878:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some-host:21050 with PLAIN authentication mechanism
2023-04-27 15:32:39,878:DEBUG:impala._thrift_api:get_socket: host=some-host port=21050 use_ssl=True ca_cert=/certs/ca.crt
2023-04-27 15:32:39,879:DEBUG:impala.hiveserver2:sock=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faedc480a00>
2023-04-27 15:32:39,879:DEBUG:impala._thrift_api:get_transport: socket=<impala._thrift_api.get_socket.<locals>.ImpalaTSSLSocket object at 0x7faedc480a00> host=some-host kerberos_service_name=impala auth_mechanism=PLAIN user=some-user password=fuggetaboutit

2023-04-27 15:32:39,980:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7faedc480e80> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7faedc480af0> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faedc4806a0>
2023-04-27 15:32:39,980:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7faedc480e50>, default_db=some_schema)
2023-04-27 15:32:39,980:DEBUG:impala.hiveserver2:Closing HS2 connection
2023-04-27 15:32:39,980:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7faedc4806a0>
xxx.xxx.xxx.xxx - - [27/Apr/2023:15:32:39 +0000] "GET /api/v1/database/19/tables/?q=(force:!t,schema_name:some_schema) HTTP/1.1" 422 76 "https://superset-host:8888/superset/sqllab/" "Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/108.0.0.0 Safari/537.36"

Also I tested when schema has about 40 tables and 0 tables with same result

@VitaliyFedorov VitaliyFedorov added the #bug Bug report label Apr 27, 2023
@nferrario
Copy link

Same here!

@linxt20
Copy link

linxt20 commented Apr 29, 2023

I meet the same problem

@giuturtu
Copy link

Same here!

@raulbla
Copy link

raulbla commented May 17, 2023

I can confirm we have the same issue. Instead the query from sql tab is working fine

@0xfcryowbk2ca65z
Copy link

Same here!

@MarioDurantez
Copy link

I met a similar problem with an Athena datasource. I found that superset 2.1.0 uses SQLAlchemy's get_view_names() here. The pyAthena version suggested in the docs did not implement this call, and the NotImplementedError was being caught and supressed by superset code.

I solved by upgrading pyAthena to >=2.0.0, which already implements get_view_names(). Unfortunately, the most recent Impala driver for sqlAlchemy does not implement this call, only get_table_names().

Currently the only solution seems to be downgrading Superset to 2.0.1.

@huw0
Copy link

huw0 commented May 22, 2023

Thanks @MarioDurantez for this pointer.

I've raised a PR which stubs this method - cloudera/impyla#511. For now, I'm manually patching this file as part of our Docker build pipeline.

@chathawee
Copy link

@huw0 Could you please provide the solution. I have tried to add this fuction to superset/db_engine_specs/impala.py but it didn't work. Please suggest.

@VitaliyFedorov
Copy link
Author

@huw0 Could you please provide the solution. I have tried to add this fuction to superset/db_engine_specs/impala.py but it didn't work. Please suggest.

I've just build impyla with his PR and install it via pip in superset dockerfile.
@huw0 patch impyla code, not superset

@rusackas
Copy link
Member

Is this still an issue people are facing in Superset 3.x?

@pyroman30
Copy link

Same here!

@pyroman30 pyroman30 mentioned this issue Apr 3, 2024
@rusackas rusackas added the data:connect:impala Related to Impala label Apr 3, 2024
@rusackas
Copy link
Member

rusackas commented Apr 3, 2024

@pyroman30 which version of Superset are you using, and which version of the Impala driver? If "same here" means you're using the old versions, as reported in the initial report, then you need to update both pieces of software.

@pyroman30
Copy link

@rusackas I'm using helm chart version 2.0.1 and impyla version 0.18.0. I can't figure out how to view the impala driver version?

@dkrat7
Copy link
Contributor

dkrat7 commented Apr 4, 2024

@pyroman30
get_view_name support was added in impyla==0.19.0. You should try with that version.

@pyroman30
Copy link

@dkrat7 thanks for the answer, unfortunately it didn't work

@pyroman30
Copy link

2024-04-04 06:57:22,363:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some_host:21050 with GSSAPI authentication mechanism
2024-04-04 06:57:22,363:DEBUG:impala._thrift_api:get_socket: host=some_host port=21050 use_ssl=False ca_cert=None
2024-04-04 06:57:22,363:DEBUG:impala.hiveserver2:sock=<thrift.transport.TSocket.TSocket object at 0x7f46c4e4e790>
2024-04-04 06:57:22,364:DEBUG:impala._thrift_api:get_transport: socket=<thrift.transport.TSocket.TSocket object at 0x7f46c4e4e790> host=some_host kerberos_service_name=impala auth_mechanism=GSSAPI user=None password=fuggetaboutit
2024-04-04 06:57:22,454:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7f4615d06280> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7f46c4e57190> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f46c4e4eca0>
2024-04-04 06:57:22,454:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7f46c4de18e0>, default_db=p_datalake)
2024-04-04 06:57:22,455:DEBUG:impala.hiveserver2:Closing HS2 connection
2024-04-04 06:57:22,455:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f46c4e4eca0>
2024-04-04 06:57:22,456:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some_host:21050 with GSSAPI authentication mechanism
2024-04-04 06:57:22,456:DEBUG:impala._thrift_api:get_socket: host=some_host port=21050 use_ssl=False ca_cert=None
2024-04-04 06:57:22,456:DEBUG:impala.hiveserver2:sock=<thrift.transport.TSocket.TSocket object at 0x7f46c4e4e760>
2024-04-04 06:57:22,456:DEBUG:impala._thrift_api:get_transport: socket=<thrift.transport.TSocket.TSocket object at 0x7f46c4e4e760> host=some_host kerberos_service_name=impala auth_mechanism=GSSAPI user=None password=fuggetaboutit
2024-04-04 06:57:22,517:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7f46c4e4e8b0> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7f46c4e4e790> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f46c4de1940>
2024-04-04 06:57:22,517:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7f46c4de18e0>, default_db=p_datalake)
2024-04-04 06:57:22,517:DEBUG:impala.hiveserver2:Getting a cursor (Impala session)
2024-04-04 06:57:22,518:DEBUG:impala.hiveserver2:.cursor(): getting new session_handle
2024-04-04 06:57:22,518:DEBUG:impala.hiveserver2:OpenSession: req=TOpenSessionReq(client_protocol=5, username='root', password=None, configuration={})
2024-04-04 06:57:22,518:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:57:22,519:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:57:22,521:DEBUG:impala.hiveserver2:OpenSession: resp=TOpenSessionResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), serverProtocolVersion=5, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xa7\xd8\x8f\x00w+B\x0c\x91\xf2\xc9\xa8\xde\xfcS\xd1', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"')), configuration={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_HINTS_INSERT_STATEMENT': '', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'BROADCAST', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MEM_LIMIT': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_READ_STATISTICS': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some_host:25000'})
2024-04-04 06:57:22,521:DEBUG:impala.hiveserver2:HiveServer2Cursor(service=<impala.hiveserver2.HS2Service object at 0x7f46c4de18e0>, session_handle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xa7\xd8\x8f\x00w+B\x0c\x91\xf2\xc9\xa8\xde\xfcS\xd1', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"')), default_config={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_HINTS_INSERT_STATEMENT': '', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'BROADCAST', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MEM_LIMIT': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_READ_STATISTICS': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some_host:25000'}, hs2_protocol_version=5)
2024-04-04 06:57:22,522:INFO:impala.hiveserver2:Using database p_datalake as default
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:Executing query USE p_datalake
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xa7\xd8\x8f\x00w+B\x0c\x91\xf2\xc9\xa8\xde\xfcS\xd1', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"')), statement='USE p_datalake', confOverlay=None, runAsync=True)
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:57:22,525:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:57:22,561:DEBUG:impala.hiveserver2:ExecuteStatement: resp=TExecuteStatementResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'O\xef\x89Q\x9f\xd8Ct\x00\x00\x00\x00\xd6\x8b\xa1\xb3', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2024-04-04 06:57:22,561:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'O\xef\x89Q\x9f\xd8Ct\x00\x00\x00\x00\xd6\x8b\xa1\xb3', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2024-04-04 06:57:22,561:DEBUG:impala.hiveserver2:Waiting for query to finish
2024-04-04 06:57:22,561:DEBUG:impala.hiveserver2:GetOperationStatus: req=TGetOperationStatusReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'O\xef\x89Q\x9f\xd8Ct\x00\x00\x00\x00\xd6\x8b\xa1\xb3', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2024-04-04 06:57:22,562:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:57:22,562:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:57:22,563:DEBUG:impala.hiveserver2:GetOperationStatus: resp=TGetOperationStatusResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationState=2, sqlState=None, errorCode=None, errorMessage=None, hasResultSet=None)
2024-04-04 06:57:22,563:DEBUG:impala.hiveserver2:_wait_to_finish: waited 0.0019729137420654297 seconds so far
2024-04-04 06:57:22,564:DEBUG:impala.hiveserver2:Query finished
2024-04-04 06:57:22,564:DEBUG:impala.hiveserver2:Executing query SHOW SCHEMAS
2024-04-04 06:57:22,564:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'O\xef\x89Q\x9f\xd8Ct\x00\x00\x00\x00\xd6\x8b\xa1\xb3', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2024-04-04 06:57:22,565:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2024-04-04 06:57:22,565:DEBUG:impala.hiveserver2:CloseOperation: req=TCloseOperationReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'O\xef\x89Q\x9f\xd8Ct\x00\x00\x00\x00\xd6\x8b\xa1\xb3', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2024-04-04 06:57:22,565:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:57:22,565:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:57:22,567:DEBUG:impala.hiveserver2:CloseOperation: resp=TCloseOperationResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None))
2024-04-04 06:57:22,567:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:57:22,567:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b'\xa7\xd8\x8f\x00w+B\x0c\x91\xf2\xc9\xa8\xde\xfcS\xd1', secret=b'\x81\xfc\xa8"\xda@I\x8b\xa8\xa2a\xc4b\xcce"')), statement='SHOW SCHEMAS', confOverlay=None, runAsync=True)
2024-04-04 06:57:22,568:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:57:22,568:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:58:22,306:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some_host:21050 with GSSAPI authentication mechanism
2024-04-04 06:58:22,306:DEBUG:impala._thrift_api:get_socket: host=some_host port=21050 use_ssl=False ca_cert=None
2024-04-04 06:58:22,306:DEBUG:impala.hiveserver2:sock=<thrift.transport.TSocket.TSocket object at 0x7f4615de19a0>
2024-04-04 06:58:22,306:DEBUG:impala._thrift_api:get_transport: socket=<thrift.transport.TSocket.TSocket object at 0x7f4615de19a0> host=some_host kerberos_service_name=impala auth_mechanism=GSSAPI user=None password=fuggetaboutit
2024-04-04 06:58:22,431:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7f4615de1b20> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7f4615de1430> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f4615de1340>
2024-04-04 06:58:22,431:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7f4615de14c0>, default_db=p_datalake)
2024-04-04 06:58:22,432:DEBUG:impala.hiveserver2:Closing HS2 connection
2024-04-04 06:58:22,432:DEBUG:impala.hiveserver2:close_service: client=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f4615de1340>
2024-04-04 06:58:22,432:DEBUG:impala.hiveserver2:Connecting to HiveServer2 some_host:21050 with GSSAPI authentication mechanism
2024-04-04 06:58:22,432:DEBUG:impala._thrift_api:get_socket: host=some_host port=21050 use_ssl=False ca_cert=None
2024-04-04 06:58:22,432:DEBUG:impala.hiveserver2:sock=<thrift.transport.TSocket.TSocket object at 0x7f4615de14c0>
2024-04-04 06:58:22,432:DEBUG:impala._thrift_api:get_transport: socket=<thrift.transport.TSocket.TSocket object at 0x7f4615de14c0> host=some_host kerberos_service_name=impala auth_mechanism=GSSAPI user=None password=fuggetaboutit
2024-04-04 06:58:22,536:DEBUG:impala.hiveserver2:transport=<thrift_sasl.TSaslClientTransport object at 0x7f4615de1970> protocol=<thrift.protocol.TBinaryProtocol.TBinaryProtocolAccelerated object at 0x7f4615de1e20> service=<impala._thrift_gen.ImpalaService.ImpalaHiveServer2Service.Client object at 0x7f4615de1a00>
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:HiveServer2Connection(service=<impala.hiveserver2.HS2Service object at 0x7f4615de1880>, default_db=p_datalake)
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:Getting a cursor (Impala session)
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:.cursor(): getting new session_handle
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:OpenSession: req=TOpenSessionReq(client_protocol=5, username='root', password=None, configuration={})
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:58:22,537:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:58:22,539:DEBUG:impala.hiveserver2:OpenSession: resp=TOpenSessionResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), serverProtocolVersion=5, sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b"\x01c\xbd\x84'\xedG^\xb3\xf1y\x13V\xf1\xa6\x91", secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/')), configuration={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_HINTS_INSERT_STATEMENT': '', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'BROADCAST', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MEM_LIMIT': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_READ_STATISTICS': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some_host:25000'})
2024-04-04 06:58:22,539:DEBUG:impala.hiveserver2:HiveServer2Cursor(service=<impala.hiveserver2.HS2Service object at 0x7f4615de1880>, session_handle=TSessionHandle(sessionId=THandleIdentifier(guid=b"\x01c\xbd\x84'\xedG^\xb3\xf1y\x13V\xf1\xa6\x91", secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/')), default_config={'ABORT_ON_DEFAULT_LIMIT_EXCEEDED': '', 'ABORT_ON_ERROR': '0', 'ALLOW_ERASURE_CODED_FILES': '0', 'ALLOW_UNSUPPORTED_FORMATS': '', 'APPX_COUNT_DISTINCT': '0', 'BATCH_SIZE': '0', 'BUFFER_POOL_LIMIT': '', 'CLIENT_IDENTIFIER': '', 'COMPRESSION_CODEC': '', 'COMPUTE_STATS_MIN_SAMPLE_SIZE': '1073741824', 'CPU_LIMIT_S': '0', 'DEBUG_ACTION': '', 'DECIMAL_V2': '1', 'DEFAULT_HINTS_INSERT_STATEMENT': '', 'DEFAULT_JOIN_DISTRIBUTION_MODE': 'BROADCAST', 'DEFAULT_ORDER_BY_LIMIT': '', 'DEFAULT_SPILLABLE_BUFFER_SIZE': '2097152', 'DISABLE_CACHED_READS': '', 'DISABLE_CODEGEN': '0', 'DISABLE_CODEGEN_ROWS_THRESHOLD': '50000', 'DISABLE_OUTERMOST_TOPN': '0', 'DISABLE_ROW_RUNTIME_FILTERING': '0', 'DISABLE_STREAMING_PREAGGREGATIONS': '0', 'DISABLE_UNSAFE_SPILLS': '0', 'ENABLE_EXPR_REWRITES': '1', 'EXEC_SINGLE_NODE_ROWS_THRESHOLD': '100', 'EXEC_TIME_LIMIT_S': '0', 'EXPLAIN_LEVEL': 'STANDARD', 'HBASE_CACHE_BLOCKS': '0', 'HBASE_CACHING': '0', 'IDLE_SESSION_TIMEOUT': '1800', 'KUDU_READ_MODE': 'DEFAULT', 'MAX_ERRORS': '100', 'MAX_IO_BUFFERS': '', 'MAX_MEM_ESTIMATE_FOR_ADMISSION': '0', 'MAX_NUM_RUNTIME_FILTERS': '10', 'MAX_ROW_SIZE': '524288', 'MAX_SCAN_RANGE_LENGTH': '0', 'MEM_LIMIT': '0', 'MIN_SPILLABLE_BUFFER_SIZE': '65536', 'MT_DOP': '', 'NUM_NODES': '0', 'NUM_REMOTE_EXECUTOR_CANDIDATES': '3', 'NUM_ROWS_PRODUCED_LIMIT': '0', 'NUM_SCANNER_THREADS': '0', 'OPTIMIZE_PARTITION_KEY_SCANS': '0', 'PARQUET_ANNOTATE_STRINGS_UTF8': '0', 'PARQUET_ARRAY_RESOLUTION': 'THREE_LEVEL', 'PARQUET_DICTIONARY_FILTERING': '1', 'PARQUET_FALLBACK_SCHEMA_RESOLUTION': 'POSITION', 'PARQUET_FILE_SIZE': '0', 'PARQUET_READ_STATISTICS': '1', 'PLANNER_TESTCASE_MODE': '0', 'PREFETCH_MODE': 'HT_BUCKET', 'QUERY_TIMEOUT_S': '0', 'REPLICA_PREFERENCE': 'CACHE_LOCAL', 'REQUEST_POOL': '', 'RESERVATION_REQUEST_TIMEOUT': '', 'RESOURCE_TRACE_RATIO': '0.000000', 'RM_INITIAL_MEM': '', 'RUNTIME_BLOOM_FILTER_SIZE': '1048576', 'RUNTIME_FILTER_MAX_SIZE': '16777216', 'RUNTIME_FILTER_MIN_SIZE': '1048576', 'RUNTIME_FILTER_MODE': 'GLOBAL', 'RUNTIME_FILTER_WAIT_TIME_MS': '0', 'S3_SKIP_INSERT_STAGING': '1', 'SCAN_BYTES_LIMIT': '0', 'SCAN_NODE_CODEGEN_THRESHOLD': '', 'SCHEDULE_RANDOM_REPLICA': '0', 'SCRATCH_LIMIT': '-1', 'SEQ_COMPRESSION_MODE': '', 'SHUFFLE_DISTINCT_EXPRS': '1', 'STRICT_MODE': '0', 'SYNC_DDL': '0', 'THREAD_RESERVATION_AGGREGATE_LIMIT': '0', 'THREAD_RESERVATION_LIMIT': '3000', 'TIMEZONE': '', 'TOPN_BYTES_LIMIT': '536870912', 'V_CPU_CORES': '', 'http_addr': 'some_host:25000'}, hs2_protocol_version=5)
2024-04-04 06:58:22,539:INFO:impala.hiveserver2:Using database p_datalake as default
2024-04-04 06:58:22,539:DEBUG:impala.hiveserver2:Executing query USE p_datalake
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b"\x01c\xbd\x84'\xedG^\xb3\xf1y\x13V\xf1\xa6\x91", secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/')), statement='USE p_datalake', confOverlay=None, runAsync=True)
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:58:22,540:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:58:22,575:DEBUG:impala.hiveserver2:ExecuteStatement: resp=TExecuteStatementResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\x08.\x1c\x0c\xfe\x1cEn\x00\x00\x00\x00\xa1\xbe%', secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/'), operationType=0, hasResultSet=False, modifiedRowCount=None)) 2024-04-04 06:58:22,576:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'\x08.\x1c\x0c\xfe\x1cEn\x00\x00\x00\x00\xa1\xbe%', secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2024-04-04 06:58:22,576:DEBUG:impala.hiveserver2:Waiting for query to finish
2024-04-04 06:58:22,576:DEBUG:impala.hiveserver2:GetOperationStatus: req=TGetOperationStatusReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\x08.\x1c\x0c\xfe\x1cEn\x00\x00\x00\x00\xa1\xbe%', secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/'), operationType=0, hasResultSet=False, modifiedRowCount=None)) 2024-04-04 06:58:22,576:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3) 2024-04-04 06:58:22,576:DEBUG:impala.hiveserver2:Transport opened 2024-04-04 06:58:22,578:DEBUG:impala.hiveserver2:GetOperationStatus: resp=TGetOperationStatusResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None), operationState=2, sqlState=None, errorCode=None, errorMessage=None, hasResultSet=None) 2024-04-04 06:58:22,578:DEBUG:impala.hiveserver2:_wait_to_finish: waited 0.0021505355834960938 seconds so far 2024-04-04 06:58:22,578:DEBUG:impala.hiveserver2:Query finished 2024-04-04 06:58:22,578:DEBUG:impala.hiveserver2:Executing query SHOW SCHEMAS 2024-04-04 06:58:22,579:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=True self._last_operation=TOperationHandle(operationId=THandleIdentifier(guid=b'\x08.\x1c\x0c\xfe\x1cEn\x00\x00\x00\x00\xa1\xbe%', secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/'), operationType=0, hasResultSet=False, modifiedRowCount=None)
2024-04-04 06:58:22,579:DEBUG:impala.hiveserver2:_reset_state: Resetting cursor state
2024-04-04 06:58:22,579:DEBUG:impala.hiveserver2:CloseOperation: req=TCloseOperationReq(operationHandle=TOperationHandle(operationId=THandleIdentifier(guid=b'\x08.\x1c\x0c\xfe\x1cEn\x00\x00\x00\x00\xa1`\xbe%', secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/'), operationType=0, hasResultSet=False, modifiedRowCount=None))
2024-04-04 06:58:22,579:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:58:22,579:DEBUG:impala.hiveserver2:Transport opened
2024-04-04 06:58:22,581:DEBUG:impala.hiveserver2:CloseOperation: resp=TCloseOperationResp(status=TStatus(statusCode=0, infoMessages=None, sqlState=None, errorCode=None, errorMessage=None))
2024-04-04 06:58:22,582:DEBUG:impala.hiveserver2:_execute_async: self._buffer=Batch() self._description=None self._last_operation_active=False self._last_operation=None
2024-04-04 06:58:22,582:DEBUG:impala.hiveserver2:ExecuteStatement: req=TExecuteStatementReq(sessionHandle=TSessionHandle(sessionId=THandleIdentifier(guid=b"\x01c\xbd\x84'\xedG^\xb3\xf1y\x13V\xf1\xa6\x91", secret=b'\x1b\xeb\xec\xab\x15\x85B\xec\xa6\xd1x3\xcf\xb1w/')), statement='SHOW SCHEMAS', confOverlay=None, runAsync=True)
2024-04-04 06:58:22,582:DEBUG:impala.hiveserver2:Attempting to open transport (tries_left=3)
2024-04-04 06:58:22,582:DEBUG:impala.hiveserver2:Transport opened

@pyroman30
Copy link

If I change the cache parameters, it helps for a while, then it doesn't work again
Screenshot_1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
#bug Bug report data:connect:impala Related to Impala
Projects
None yet
Development

Successfully merging a pull request may close this issue.