Open
Description
Is your feature request related to a problem or challenge?
This is a follow up on #15069. A --substrait-round-trip
flag was added to the sqllogictest runner, which runs the sqllogictest suite with one additional step: when a DataFusion logical plan is produced, it's converted to Substrait and from Substrait back to DataFusion logical before executing it.
This new sqllogictest execution mode has revealed the following issues:
- [substrait] [sqllogictest] Unsupported producing row from empty relation #16271
- [substrait] [sqllogictest] Null cast is not valid #16272
- [substrait] [sqllogictest] Unsupported cast type: Dictionary(Int32, Utf8) #16273
- [substrait] [sqllogictest] Unsupported plan type: RecursiveQuery #16274
- [substrait] [sqllogictest] Unsupported cast type: Time64 #16275
- [substrait] [sqllogictest] Only literal types and aliases are supported in Virtual Tables, got: ScalarFunction #16276
- [substrait] [sqllogictest] Unsupported cast type: FixedSizeList #16278
- [substrait] [sqllogictest] Error during planning: No table named 'tmp_table' #16279
- [substrait] [sqllogictest] Cannot convert Exists { subquery: <subquery>, negated: true } to Substrait #16280
- [substrait] [sqllogictest] Cannot convert <subquery> to Substrait #16281
- [substrait] [sqllogictest] table 'datafusion.public.aggregate_test_100_by_sql' not found #16282
- [substrait] [sqllogictest] Substrait schema timestamp field mismatch #16283
- [substrait] [sqllogictest] Unsupported cast type: Duration #16285
- [substrait] [sqllogictest] Optimizer rule 'optimize_projections' failed #16287
- [substrait] [sqllogictest] Unsupported function name: "like_match", "like_imatch", "like_not_match" and "like_not_imatch" #16293
- [substrait] [sqllogictest] GroupingSet CUBE is not yet supported #16294
- [substrait] [sqllogictest] Schema contains duplicate qualified field name #16295
- [substrait] [sqllogictest] Unsupported cast type: Time32(Second) #16296
- [substrait] [sqllogictest] Unsupported window frame unit: Groups #16297
- [substrait] [sqllogictest] Unsupported cast type: Float16 #16298
Describe the solution you'd like
A fix to the mentioned issues so that the sqllogictest in Substrait round-trip mode can run in the CI