GH-36928: [Java] Make it run well with the netty newest version 4.1.96

[panbingkun]

When I used netty arrow memory 13.0.0 and netty 4.1.96.Final in Spark, the following error occurred,
Because netty 4.1.96.Final version has revert some modifications, in order to ensure that netty arrow memory 13.0.0 works well with netty 4.1.96.Final version, I suggest making similar modifications here.
1.Compilation errors are as follows:
https://ci.appveyor.com/project/ApacheSoftwareFoundation/spark/builds/47657403

2.Some modifications have been reverted in netty 4.1.96.Final as follows:


https://netty.io/news/2023/07/27/4-1-96-Final.html
netty/netty#13510

• Closes: [Java] Make it run well with the netty newest version 4.1.96 #36928

[github-actions]

Thanks for opening a pull request!

If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

In the case of PARQUET issues on JIRA the title also supports:

PARQUET-${JIRA_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

See also:

• Other pull requests
• Contribution Guidelines - How to contribute patches

[panbingkun]

When I used netty arrow memory 13.0.0 and netty 4.1.96.Final in Spark, the following error occurred,
Because netty 4.1.96.Final version has revert some modifications, in order to ensure that netty arrow memory 13.0.0 works well with netty 4.1.96.Final version, I suggest making similar modifications here.
1.Compilation errors are as follows:
https://ci.appveyor.com/project/ApacheSoftwareFoundation/spark/builds/47657403

2.Some modifications have been reverted in netty 4.1.96.Final as follows:


https://netty.io/news/2023/07/27/4-1-96-Final.html
netty/netty#13510

[github-actions]

⚠️ GitHub issue #36928 has been automatically assigned in GitHub to PR creator.

[lidavidm]

Thank you for catching this!

@raulcd since we don't have RC2 out yet, would it be possible to cherry-pick this too? It also apparently avoids a potential performance regression in Flight

[raulcd]

Sure! that sounds good to me!

[lidavidm]

Thanks Raúl! I added this to the 13.0.0 milestone, I'll go update the blog post too

[raulcd]

I added this to the 13.0.0 milestone

cherry-picked to maint-13.0.0

[lidavidm]

@github-actions crossbow submit spark

[github-actions]

Revision: 3006cfc

Submitted crossbow builds: ursacomputing/crossbow @ actions-1f081194d6

Task	Status
test-conda-python-3.10-spark-master
test-conda-python-3.8-spark-v3.1.2
test-conda-python-3.9-spark-v3.2.0

[conbench-apache-arrow]

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit 6b1c723.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.