Skip to content

[SPARK-3141] [PySpark] fix sortByKey() with take() #2045

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

davies
Copy link
Contributor

@davies davies commented Aug 19, 2014

Fix sortByKey() with take()

The function f used in mapPartitions should always return an iterator.

@SparkQA
Copy link

SparkQA commented Aug 20, 2014

QA tests have started for PR 2045 at commit 1160f59.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Aug 20, 2014

QA tests have finished for PR 2045 at commit 1160f59.

  • This patch fails unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@davies
Copy link
Contributor Author

davies commented Aug 20, 2014

Jenkins, retest this please

@SparkQA
Copy link

SparkQA commented Aug 20, 2014

QA tests have started for PR 2045 at commit 1160f59.

  • This patch merges cleanly.

@SparkQA
Copy link

SparkQA commented Aug 20, 2014

QA tests have finished for PR 2045 at commit 1160f59.

  • This patch fails unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@pwendell
Copy link
Contributor

Jenkins, test this please.

@mateiz
Copy link
Contributor

mateiz commented Aug 20, 2014

Looks good to me

@pwendell
Copy link
Contributor

Thanks matei, I'll pull this one.

asfgit pushed a commit that referenced this pull request Aug 20, 2014
Fix sortByKey() with take()

The function `f` used in mapPartitions should always return an iterator.

Author: Davies Liu <davies.liu@gmail.com>

Closes #2045 from davies/fix_sortbykey and squashes the following commits:

1160f59 [Davies Liu] fix sortByKey() with take()
(cherry picked from commit 0a7ef63)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
@asfgit asfgit closed this in 0a7ef63 Aug 20, 2014
xiliu82 pushed a commit to xiliu82/spark that referenced this pull request Sep 4, 2014
Fix sortByKey() with take()

The function `f` used in mapPartitions should always return an iterator.

Author: Davies Liu <davies.liu@gmail.com>

Closes apache#2045 from davies/fix_sortbykey and squashes the following commits:

1160f59 [Davies Liu] fix sortByKey() with take()
@davies davies deleted the fix_sortbykey branch September 15, 2014 22:18
szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Sep 24, 2024
* Bump comet to 0.2.0.0-apple and apply 3.4.3 diff

* fix

* comment out lateral_view_noalias for now

---------

Co-authored-by: huaxingao <huaxin.gao11@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants