Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-36384][CORE][DOC] Add doc for shuffle checksum #33637

Closed
wants to merge 1 commit into from

Conversation

Ngone51
Copy link
Member

@Ngone51 Ngone51 commented Aug 4, 2021

What changes were proposed in this pull request?

Add doc for the shuffle checksum configs in configuration.md.

Why are the changes needed?

doc

Does this PR introduce any user-facing change?

No, since Spark 3.2 hasn't been released.

How was this patch tested?

Pass existed tests.

@Ngone51
Copy link
Member Author

Ngone51 commented Aug 4, 2021

cc @mridulm @otterc Please take a look, thanks!

@SparkQA
Copy link

SparkQA commented Aug 4, 2021

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46550/

@SparkQA
Copy link

SparkQA commented Aug 4, 2021

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46550/

@SparkQA
Copy link

SparkQA commented Aug 4, 2021

Test build #142038 has finished for PR 33637 at commit 55bcbf9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Contributor

@otterc otterc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

HyukjinKwon pushed a commit that referenced this pull request Aug 5, 2021
### What changes were proposed in this pull request?

Add doc for the shuffle checksum configs in `configuration.md`.

### Why are the changes needed?

doc

### Does this PR introduce _any_ user-facing change?

No, since Spark 3.2 hasn't been released.

### How was this patch tested?

Pass existed tests.

Closes #33637 from Ngone51/SPARK-36384.

Authored-by: yi.wu <yi.wu@databricks.com>
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
(cherry picked from commit 3b92c72)
Signed-off-by: Hyukjin Kwon <gurwls223@apache.org>
@HyukjinKwon
Copy link
Member

Merged to master and branch-3.2.

@mridulm
Copy link
Contributor

mridulm commented Aug 5, 2021

Late LGTM, thanks for adding this @Ngone51 !

@Ngone51
Copy link
Member Author

Ngone51 commented Aug 5, 2021

Thanks all!

1 similar comment
@Ngone51
Copy link
Member Author

Ngone51 commented Aug 5, 2021

Thanks all!

@Ngone51 Ngone51 deleted the SPARK-36384 branch August 5, 2021 12:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants