- 
        Couldn't load subscription status. 
- Fork 246
Closed
Labels
enhancementNew feature or requestNew feature or request
Milestone
Description
What is the problem the feature request solves?
#1209 enabled accelerating more queries with Comet but also exposed some new bugs so a COMET_SHUFFLE_FALLBACK_TO_COLUMNAR config was added as a temporary workaround to avoid Spark SQL tests failing.
We should remove this config once the bugs are fixed so that we test more of the Spark SQL queries with Comet shuffle.
Issues:
Failing tests:
core1
- SPARK-32038: NormalizeFloatingNumbers should work on distinct aggregate *** FAILED *** (551 milliseconds)
- update nested struct fields *** FAILED *** (98 milliseconds)
- merge with updates to nested struct fields in NOT MATCHED BY SOURCE clauses *** FAILED *** (94 milliseconds)
- WholeStageCodeGenSuite
- Spark SQL test "test with low buffer spill threshold" fails when shuffle mode is jvm #1252
core2
- subquery/exists-subquery/exists-orderby-limit.sql *** FAILED *** (4 seconds, 72 milliseconds)
- typeCoercion/native/windowFrameCoercion.sql *** FAILED *** (1 second, 540 milliseconds)
core3
- SPARK-32649: Optimize BHJ/SHJ inner/semi join with empty hashed relation *** FAILED *** (145 milliseconds)
- assertion fails on number of shuffled hash joins in plan
 
- SPARK-38237: require all cluster keys for child required distribution for window query *** FAILED *** (183 milliseconds)
- shuffleByRequirement was false Can't find desired shuffle node from the query plan [test needs updating]
 
Describe the potential solution
No response
Additional context
No response
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request