Skip to content

Commit e84e9dd

Browse files
dongjoon-hyungatorsmile
authored andcommitted
[SPARK-20735][SQL][TEST] Enable cross join in TPCDSQueryBenchmark
## What changes were proposed in this pull request? Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_". This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`. ## How was this patch tested? Manual. (Run TPCDSQueryBenchmark) Author: Dongjoon Hyun <dongjoon@apache.org> Closes #17977 from dongjoon-hyun/SPARK-20735. (cherry picked from commit bbd163d) Signed-off-by: Xiao Li <gatorsmile@gmail.com>
1 parent a79a120 commit e84e9dd

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/TPCDSQueryBenchmark.scala

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -43,6 +43,7 @@ object TPCDSQueryBenchmark {
4343
.set("spark.driver.memory", "3g")
4444
.set("spark.executor.memory", "3g")
4545
.set("spark.sql.autoBroadcastJoinThreshold", (20 * 1024 * 1024).toString)
46+
.set("spark.sql.crossJoin.enabled", "true")
4647

4748
val spark = SparkSession.builder.config(conf).getOrCreate()
4849

0 commit comments

Comments
 (0)