-
Notifications
You must be signed in to change notification settings - Fork 4.8k
HIVE-21737: Upgrade Avro to version 1.10.1 #1806
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Thanks @iemejia . Can you fix the compilation error? |
Yes you are right @sunchao I care about this one, but it seems it opened a pandora box of unrelated dependency issues, it is more important to get into the Spark 3.1.0 release train so let's better go ahead with the vote without this update. |
Any update? Spark community has created 3.1.0 RC1: https://github.com/apache/spark/releases/tag/v3.1.0-rc1 |
I think we just need to verify that the combination of Hive 2.3.8/Parquet 1.11.1/Avro 1.10.1 works for Spark before sending out a vote. @heuermh have you got a chance to try it out? Thanks. |
@sunchao With the changes in bigdatagenomics/adam#2289 to remove various workarounds, the combination in pull request apache/spark#30517 works for us. |
Thanks @heuermh ! I'll start a vote on Hive 2.3.8 soon. |
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. |
R: @sunchao