Skip to content

[SPARK-14028][STREAMING][KINESIS][TESTS] Remove deprecated methods; fix two other warnings #11850

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed

Conversation

lw-lin
Copy link
Contributor

@lw-lin lw-lin commented Mar 20, 2016

What changes were proposed in this pull request?

  • Removed two methods that has been deprecated since 1.4
  • Fixed two other compilation warnings

How was this patch tested?

existing test suits

"https://kinesis.us-west-2.amazonaws.com", new Duration(2000),
InitialPositionInStream.LATEST, StorageLevel.MEMORY_AND_DISK_2());
String dummyEndpointUrl = KinesisTestUtils.defaultEndpointUrl();
String dummyRegionName = RegionUtils.getRegionByEndpoint(dummyEndpointUrl).getName();

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This JavaDStream is created by the deprecated & removed createStream method; so let's switch to another createStream method.

@srowen
Copy link
Member

srowen commented Mar 20, 2016

OK by me

@@ -40,7 +40,7 @@ trait KinesisFunSuite extends SparkFunSuite {
if (shouldRunTests) {
body
} else {
ignore(s"$message [enable by setting env var $envVarNameForEnablingTests=1]")()
ignore(s"$message [enable by setting env var $envVarNameForEnablingTests=1]")(())
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Without the (), scalac will add this () implicitly and then complain that this is probably not we want. So let's add this () explicitly to erase this warning.

@srowen
Copy link
Member

srowen commented Mar 20, 2016

Jenkins test this please

@SparkQA
Copy link

SparkQA commented Mar 20, 2016

Test build #53630 has finished for PR 11850 at commit 1a92374.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@srowen
Copy link
Member

srowen commented Mar 21, 2016

Merged to master

@asfgit asfgit closed this in c35c60f Mar 21, 2016
@lw-lin
Copy link
Contributor Author

lw-lin commented Mar 21, 2016

@srowen thanks for the review!

@lw-lin lw-lin deleted the streaming-kinesis-deprecates-warnings branch March 21, 2016 08:28
roygao94 pushed a commit to roygao94/spark that referenced this pull request Mar 22, 2016
…ix two other warnings

## What changes were proposed in this pull request?

- Removed two methods that has been deprecated since 1.4
- Fixed two other compilation warnings

## How was this patch tested?

existing test suits

Author: proflin <proflin.me@gmail.com>

Closes apache#11850 from lw-lin/streaming-kinesis-deprecates-warnings.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants