Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update release scripts to support publishing Spark 3.2 with Scala 2.13 support to Maven #4167

Merged
merged 2 commits into from
May 18, 2022

Conversation

kbendick
Copy link
Contributor

Noticed we added support for Scala 2.13 with Spark 3.2 recently, but the release scripts have not been updated to reflect that. The nightly release workflow has been updated to publish Scala 2.13 artifacts: #4009

This came up as a result of this discussion: #4157 (comment). There's probably more work to do, and I can covert this to an issue if somebody else wants to take over.

@github-actions github-actions bot added the INFRA label Feb 18, 2022
Copy link
Contributor Author

@kbendick kbendick left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't have signing privileges, but I tested this with Java 8 and a rebuild was invoked in between each.

However, I think that release.gradle needs to be updated to not publish all artifacts for the newly added case.

dev/stage-binaries.sh Outdated Show resolved Hide resolved
dev/stage-binaries.sh Outdated Show resolved Hide resolved
dev/stage-binaries.sh Outdated Show resolved Hide resolved
@kbendick kbendick force-pushed the patch-3 branch 2 times, most recently from f52d7e1 to 7744eed Compare February 21, 2022 23:46
@kbendick kbendick marked this pull request as ready for review February 21, 2022 23:47
@kbendick kbendick changed the title Update release scripts to support Scala 2.13 Update release scripts to support publishing Spark 3.2 with Scala 2.13 support to Maven Feb 21, 2022
@fqaiser94
Copy link
Contributor

Any updates on what exactly this PR is waiting for? I see this branch has conflicts with master, but anything else?
(Also, my apologies for not catching this issue in my earlier PR).

@rdblue
Copy link
Contributor

rdblue commented May 13, 2022

Looks like it needs to fix the conflicts. After that I can take another look.

@fqaiser94
Copy link
Contributor

I can pick this up over the weekend if @kbendick doesn't get to it before then.
I'll have to create a separate PR for it though.

@kbendick
Copy link
Contributor Author

kbendick commented May 17, 2022

I can fix the conflicts now. Thank you though @fqaiser94. And thank you for drawing attention to this PR again.

I was out of town for a wedding and didn't see these comments as I've been catching up So we'll get this in right away.

Noticed we added support for Scala 2.13 with Spark 3.2 recently, but the build scripts have not been updated to reflect that.

This came up as a result of this discussion: apache#4157 (comment). There's possibly more work to do
dev/stage-binaries.sh Outdated Show resolved Hide resolved
@rdblue rdblue merged commit a918489 into apache:master May 18, 2022
@rdblue
Copy link
Contributor

rdblue commented May 18, 2022

Thanks, @kbendick! And thanks for making sure this went in, @fqaiser94!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants