Skip to content

[SPARK-11595] [SQL] [BRANCH-1.5] Fixes ADD JAR when the input path contains URL scheme #9570

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

liancheng
Copy link
Contributor

This PR backports #9569 to branch-1.5.

@SparkQA
Copy link

SparkQA commented Nov 9, 2015

Test build #45372 has finished for PR 9570 at commit 8d06b98.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Nov 10, 2015

Test build #2022 has finished for PR 9570 at commit 8d06b98.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yhuai
Copy link
Contributor

yhuai commented Nov 11, 2015

Is the failed test a legitimate one?

@liancheng
Copy link
Contributor Author

The failure is because of another bug that has been fixed in master by PR #9277. Will update the test case here and see whether we should backport #9277 to branch-1.5.

@SparkQA
Copy link

SparkQA commented Nov 11, 2015

Test build #45639 has finished for PR 9570 at commit 3c0f368.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@yhuai
Copy link
Contributor

yhuai commented Nov 11, 2015

Let's add this test in thfitserver tests.

val jarPath = TestHive.getHiveFile("TestUDTF.jar").getCanonicalPath

// SPARK-11595 Fixes ADD JAR when input path contains URL scheme
val jarURL = s"file://$jarPath"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we also check a URL without a scheme?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to remove an added jar? I'm afraid if we add the other test case, these two may interfere with each other.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually there are other test cases that already covered the case without a scheme. So I think it's fine.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it is not possible.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok

@liancheng
Copy link
Contributor Author

I've added the Thrift server test case in #9664. Thrift test cases are fairly slow. Would like to combine them.

#9664 is for master branch, opening backport branch for branch-1.5 soon.

@yhuai
Copy link
Contributor

yhuai commented Nov 12, 2015

Thanks! Merging to branch 1.5.

asfgit pushed a commit that referenced this pull request Nov 12, 2015
…ains URL scheme

This PR backports #9569 to branch-1.5.

Author: Cheng Lian <lian@databricks.com>

Closes #9570 from liancheng/spark-11595.for-branch-1.5.
@yhuai
Copy link
Contributor

yhuai commented Nov 12, 2015

I have merged it to branch 1.5.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants