Skip to content

[SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page #47353

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

yaooqinn
Copy link
Member

What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

Why are the changes needed?

doc fix

Does this PR introduce any user-facing change?

no

How was this patch tested?

doc build

Was this patch authored or co-authored using generative AI tooling?

no

@github-actions github-actions bot added the DOCS label Jul 15, 2024
@@ -214,7 +214,7 @@ The following table describes the different options available for configuring th
Cipher mode to use. Defaults "AES/CTR/NoPadding" for backward compatibility, which is not authenticated.
Recommended to use "AES/GCM/NoPadding", which is an authenticated encryption mode.
</td>
<td>4.0.0</td>
<td>4.0.0, 3.5.2, 3.4.4</td>
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will set this field to '3.4.4' as usual. It's okay when we fix it in one or two branches, but issues arise when we continue to backport more than 2 branches. The problem here is that it only tells us that 3.4.x (x>=4) and x.y.z (x>=4), but it can't tell us which version of 3.5 has it.

I suggest that we add the full list of fixed versions according to the corresponding JIRA ticket.

See the discussion here #47325 (comment)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will set this field to '3.4.4' as usual. It's okay when we fix it in one or two branches, but issues arise when we continue to backport more than 2 branches. The problem here is that it only tells us that 3.4.x (x>=4) and x.y.z (x>=4), but it can't tell us which version of 3.5 has it.

I suggest that we add the full list of fixed versions according to the corresponding JIRA ticket.

See the discussion here #47325 (comment)

To @yaooqinn , actually, I disagreed with the suggestion.

Copy link
Contributor

@mridulm mridulm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this @yaooqinn !

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To @yaooqinn and @mridulm , although this is correct, I'm wondering if we are going to make this as a standard?

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Jul 15, 2024

If we are going to allow the contributors to upgrade all configurations in this style, I'm +1.

In that case, we need to update our Apache Spark website too.

@yaooqinn
Copy link
Member Author

Hi @dongjoon-hyun If you don't mind I will start updating versions of existing configurations and add a guideline in website for incremental updates after 3.5.2-rc1

@yaooqinn yaooqinn closed this in d8820a0 Jul 16, 2024
yaooqinn added a commit that referenced this pull request Jul 16, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
yaooqinn added a commit that referenced this pull request Jul 16, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes #47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
@yaooqinn yaooqinn deleted the SPARK-47172 branch July 16, 2024 02:15
@dongjoon-hyun
Copy link
Member

Sure. Go ahead. I gave +1 to support this PR and the previous one. Initially, I was worried about consistency, but we can catch up them later, @yaooqinn .

@yaooqinn
Copy link
Member Author

Thanks @dongjoon-hyun @mridulm, merged to master/3.5/3.4

@yaooqinn yaooqinn changed the title [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.ciphersince version field on security page [SPARK-47172][DOCS][FOLLOWUP] Fix spark.network.crypto.cipher since version field on security page Jul 16, 2024
@yaooqinn
Copy link
Member Author

SPARK-48904 is filed to track, we will see if we need to break the work into a couple of subtasks

jingz-db pushed a commit to jingz-db/spark that referenced this pull request Jul 22, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Aug 7, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
(cherry picked from commit d8820a0)
Signed-off-by: Kent Yao <yao@apache.org>
attilapiros pushed a commit to attilapiros/spark that referenced this pull request Oct 4, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
himadripal pushed a commit to himadripal/spark that referenced this pull request Oct 19, 2024
…rsion field on security page

### What changes were proposed in this pull request?

Given that SPARK-47172 was an improvement but got merged into 3.4/3.5, we need to fix the since version to eliminate misunderstandings.

### Why are the changes needed?

doc fix

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

doc build

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#47353 from yaooqinn/SPARK-47172.

Authored-by: Kent Yao <yao@apache.org>
Signed-off-by: Kent Yao <yao@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants