Skip to content

[MINOR][TEST] Update from 2.2.0 to 2.2.1 in HiveExternalCatalogVersionsSuite #20597

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

seancxmao
Copy link
Contributor

What changes were proposed in this pull request?

In HiveExternalCatalogVersionsSuite, latest version of 2.2.x is updated from 2.2.0 to 2.2.1

How was this patch tested?

N/A

@SparkQA
Copy link

SparkQA commented Feb 13, 2018

Test build #4094 has finished for PR 20597 at commit 047e119.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented Feb 13, 2018

Hm:

[info] - backward compatibility *** FAILED *** (34 seconds, 96 milliseconds)
[info]   spark-submit returned with exit code 1.
[info]   Command line: './bin/spark-submit' '--class' 'org.apache.spark.sql.hive.PROCESS_TABLES' '--name' 'HiveExternalCatalog backward compatibility test' '--master' 'local[2]' '--conf' 'spark.ui.enabled=false' '--conf' 'spark.master.rest.enabled=false' '--conf' 'spark.sql.warehouse.dir=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/warehouse-a76e4f7b-3ab5-463f-83be-7e95b5172271' '--driver-java-options' '-Dderby.system.home=/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/warehouse-a76e4f7b-3ab5-463f-83be-7e95b5172271' 'file:/home/jenkins/workspace/NewSparkPullRequestBuilder/target/tmp/spark-f34f7048-27da-4dea-bbad-dec833d34fb4/testJar-1518521748609.jar'
...
[info]   2018-02-13 03:38:04.528 - stderr> Exception in thread "main" org.apache.spark.sql.AnalysisException: Operation not allowed: MSCK REPAIR TABLE only works on partitioned tables: `default`.`tbl_with_col_overlap_2`;

@SparkQA
Copy link

SparkQA commented Feb 13, 2018

Test build #4096 has finished for PR 20597 at commit 047e119.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@gatorsmile
Copy link
Member

Let me take this over and do more investigation. This looks suspicious. I think we are changing the behaviors in 2.3 and 2.2.1

@gatorsmile
Copy link
Member

This is a behavior change introduced in #19579. We need to add a migration guide for this case. Will do it by myself.

@seancxmao Thanks for your contribution!

@gatorsmile
Copy link
Member

Just submitted a PR #20606

@seancxmao seancxmao closed this Feb 24, 2018
@seancxmao seancxmao deleted the wrong_versions branch February 24, 2018 09:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants