Skip to content

[SPARK-20735][SQL][TEST] Enable cross join in TPCDSQueryBenchmark #17977

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed

[SPARK-20735][SQL][TEST] Enable cross join in TPCDSQueryBenchmark #17977

wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

What changes were proposed in this pull request?

Since SPARK-17298, some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "Use the CROSS JOIN syntax to allow cartesian products between these relations".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in TPCDSQueryBenchmark.scala.

How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

@dongjoon-hyun
Copy link
Member Author

Hi, @sameeragarwal .
Could you review this when you have sometime?

@SparkQA
Copy link

SparkQA commented May 14, 2017

Test build #76907 has finished for PR 17977 at commit 5a6d9c7.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wzhfy
Copy link
Contributor

wzhfy commented May 15, 2017

LGTM. I always set this true when running tpcds.

@dongjoon-hyun
Copy link
Member Author

Thank you for review, @wzhfy !

@sameeragarwal
Copy link
Member

LGTM, thanks!

@dongjoon-hyun
Copy link
Member Author

dongjoon-hyun commented May 15, 2017

Thank you for review, @sameeragarwal ! :D

asfgit pushed a commit that referenced this pull request May 15, 2017
## What changes were proposed in this pull request?

Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`.

## How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

Author: Dongjoon Hyun <dongjoon@apache.org>

Closes #17977 from dongjoon-hyun/SPARK-20735.

(cherry picked from commit bbd163d)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
asfgit pushed a commit that referenced this pull request May 15, 2017
## What changes were proposed in this pull request?

Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`.

## How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

Author: Dongjoon Hyun <dongjoon@apache.org>

Closes #17977 from dongjoon-hyun/SPARK-20735.

(cherry picked from commit bbd163d)
Signed-off-by: Xiao Li <gatorsmile@gmail.com>
@gatorsmile
Copy link
Member

Thanks! Merging to master/2.2/2.1

@dongjoon-hyun
Copy link
Member Author

Thank you for review and merging, @gatorsmile .

@asfgit asfgit closed this in bbd163d May 15, 2017
@dongjoon-hyun dongjoon-hyun deleted the SPARK-20735 branch May 16, 2017 16:26
robert3005 pushed a commit to palantir/spark that referenced this pull request May 19, 2017
## What changes were proposed in this pull request?

Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`.

## How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

Author: Dongjoon Hyun <dongjoon@apache.org>

Closes apache#17977 from dongjoon-hyun/SPARK-20735.
liyichao pushed a commit to liyichao/spark that referenced this pull request May 24, 2017
## What changes were proposed in this pull request?

Since [SPARK-17298](https://issues.apache.org/jira/browse/SPARK-17298), some queries (q28, q61, q77, q88, q90) in the test suites fail with a message "_Use the CROSS JOIN syntax to allow cartesian products between these relations_".

This benchmark is used as a reference model for Spark TPC-DS, so this PR aims to enable the correct configuration in `TPCDSQueryBenchmark.scala`.

## How was this patch tested?

Manual. (Run TPCDSQueryBenchmark)

Author: Dongjoon Hyun <dongjoon@apache.org>

Closes apache#17977 from dongjoon-hyun/SPARK-20735.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants