Skip to content

[SPARK-13195][Streaming]Fix NoSuchElementException when a state is not set but timeoutThreshold is defined #11081

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

zsxwing
Copy link
Member

@zsxwing zsxwing commented Feb 4, 2016

Check the state Existence before calling get.

@zsxwing
Copy link
Member Author

zsxwing commented Feb 4, 2016

cc @tdas

@tdas
Copy link
Contributor

tdas commented Feb 4, 2016

good catch. LGTM. Please merge to both 1.6 and master.

@zsxwing
Copy link
Member Author

zsxwing commented Feb 4, 2016

retest this please

@SparkQA
Copy link

SparkQA commented Feb 4, 2016

Test build #50762 has finished for PR 11081 at commit 784db1b.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@YuvalItzchakov
Copy link

Thank you guys for the quick fix. Is there a planned hotfix release soon? Or will I have to compile from source in the meanwhile?

@zsxwing
Copy link
Member Author

zsxwing commented Feb 4, 2016

Thank you guys for the quick fix. Will the updated binary be available via the spark download page or will I need to compile from source?

You need to compile from source for now. If you cannot, a workaround is always updating the state in your codes. This patch will be available in the next release 1.6.1 (should be available soon).

@zsxwing
Copy link
Member Author

zsxwing commented Feb 4, 2016

Merging to master and 1.6

asfgit pushed a commit that referenced this pull request Feb 4, 2016
…ot set but timeoutThreshold is defined

Check the state Existence before calling get.

Author: Shixiong Zhu <shixiong@databricks.com>

Closes #11081 from zsxwing/SPARK-13195.

(cherry picked from commit 8e2f296)
Signed-off-by: Shixiong Zhu <shixiong@databricks.com>
@YuvalItzchakov
Copy link

Yes, that's how I've worked around it in the meanwhile. Thx @zsxwing

@asfgit asfgit closed this in 8e2f296 Feb 4, 2016
@zsxwing zsxwing deleted the SPARK-13195 branch February 4, 2016 20:44
@ymeymann
Copy link

Just hit this issue too, thanks @zsxwing @YuvalItzchakov for the quick fix and workaround

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants