TableDoesNotExistError for MSE queries on hybrid tables

[jadami10]

I'm running a simple select * from my_table limit 10.

• this works with the v1 engine
• this works with both engines if I do my_table_REALTIME
• this works with both engines if I do my_table_OFFLINE

This fails for my_table on the v2 engine

Error Code: 190 (TableDoesNotExistError)

TableDoesNotExistError: Unable to find table in cluster, table does not exist for tables: [<my_table>]

[jadami10]

initial look seems related to #15773

[jadami10]

After tracing the code back, this is limited to the controller API and specifically the POST/GET version of /sql specifically for v2 engine. /query/sql on the broker is still working.

I'm surprised

1. how different the controller query path is vs the broker query path
2. there's no integration test for the controller's /sql. or probably there is at it's not doing a hybrid trable

[jadami10]

confirmed it's a v2 engine hybrid table issue in the linked PR

[Jackie-Jiang]

@vrajat Can you help take a look?

[vrajat]

@jadami10 I am trying to reproduce the issue. I started MultiStageEngineQuickStart and ran the following curl command as well as ran the query through the UI.

curl --request POST http://localhost:9000/sql --data '{"sql":"SELECT * from airlineStats limit 10", "queryOptions":"useMultiStageEngine=true"}'

The query ran successfully in both the cases. I am probably missing a step in my reproducer.
Can you reproduce using MultiStageEngineQuickStart ? Are there any differences in your cluster such as multiple brokers or are using a specific BrokerSelector ?

[jadami10]

I reproduced with HybridTableQuickstart. MultiStageEngineQuickStart seems to only have offline tables. This is specifically broken for v2 engine queries on hybrid tables

[vrajat]

I am able to reproduce the issue. It is because of #15773 . I'll open a PR with a fix & test soon.