Skip to content

[SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final #49923

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Feb 13, 2025

What changes were proposed in this pull request?

This PR aims to upgrade the following for Apache Spark 4.0.0.

  • netty to 4.1.118.Final
  • netty-tcnative to 2.0.70.Final

Why are the changes needed?

To bring the latest bug fixes

Does this PR introduce any user-facing change?

No behavior change.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the BUILD label Feb 13, 2025
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final [SPARK-51193][CORE] Upgrade Netty to 4.1.118.Final and netty-tcnative to 2.0.70.Final Feb 13, 2025
@dongjoon-hyun
Copy link
Member Author

Could you review this PR, @LuciferYang ? Technically, there are two CVE patches here.

Copy link
Contributor

@LuciferYang LuciferYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dongjoon-hyun
Copy link
Member Author

Thank you always, @LuciferYang !

@dongjoon-hyun
Copy link
Member Author

Thank you, @yaooqinn !

dongjoon-hyun added a commit that referenced this pull request Feb 13, 2025
… to 2.0.70.Final

### What changes were proposed in this pull request?

This PR aims to upgrade the following for Apache Spark 4.0.0.
- netty to 4.1.118.Final
- netty-tcnative to 2.0.70.Final

### Why are the changes needed?

To bring the latest bug fixes
- https://netty.io/news/2025/02/10/4-1-118-Final.html
    - https://github.com/netty/netty/releases/tag/netty-4.1.118.Final
        - netty/netty#14790
        - SslHandler doesn't correctly validate packets which can lead to native crash when using native SSLEngine
        - Denial of Service attack on windows app using Netty, again

### Does this PR introduce _any_ user-facing change?

No behavior change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #49923 from dongjoon-hyun/SPARK-51193.

Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
(cherry picked from commit 0a10232)
Signed-off-by: Dongjoon Hyun <[email protected]>
@dongjoon-hyun
Copy link
Member Author

Merged to master/4.0.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-51193 branch February 13, 2025 06:32
FMX pushed a commit to apache/celeborn that referenced this pull request Feb 15, 2025
### What changes were proposed in this pull request?

Bump Netty version from 4.1.115.Final to 4.1.118.Final.

### Why are the changes needed?

The Netty 4.1.118.Final version has been released, which netty version is 4.1.115.Final at present. The changes between 4.1.115.Final and 4.1.118.Final is as follows:

- 4.1.116.Final: https://netty.io/news/2024/12/17/4-1-116-Final.html
- 4.1.117.Final: https://netty.io/news/2025/01/14/4-1-117-Final.html
- 4.1.118.Final: https://netty.io/news/2025/02/10/4-1-118-Final.html
   - **SslHandler doesn't correctly validate packets which can lead to native crash when using native SSLEngine.**
   - **Denial of Service attack on windows app using Netty, again.**

Backport:

- apache/spark#49756
- apache/spark#49923

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

CI.

Closes #3098 from SteNicholas/CELEBORN-1864.

Authored-by: Nicholas Jiang <[email protected]>
Signed-off-by: mingji <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants