Skip to content

HIVE-21737: Upgrade Avro to version 1.10.1 #1806

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

iemejia
Copy link
Member

@iemejia iemejia commented Dec 22, 2020

@sunchao
Copy link
Member

sunchao commented Dec 22, 2020

Thanks @iemejia . Can you fix the compilation error?

@wangyum
Copy link
Member

wangyum commented Dec 25, 2020

@sunchao @iemejia Could we release Hive 2.3.8 first?

@sunchao
Copy link
Member

sunchao commented Dec 25, 2020

@iemejia what do you think? do you still plan to get this in 2.3.8? I'm hoping that we can catch the Spark 3.1.0 release train.

@wangyum curious if you have verified whether this case is resolved with Hive 2.3.8. I plan to check this by myself too before starting a new vote.

@iemejia
Copy link
Member Author

iemejia commented Dec 25, 2020

Yes you are right @sunchao I care about this one, but it seems it opened a pandora box of unrelated dependency issues, it is more important to get into the Spark 3.1.0 release train so let's better go ahead with the vote without this update.
Also we can eventually catch this up in the future and do a 2.3.9 once it works and we get more certainty that not further issues were introduced.

@wangyum
Copy link
Member

wangyum commented Jan 5, 2021

Any update? Spark community has created 3.1.0 RC1: https://github.com/apache/spark/releases/tag/v3.1.0-rc1

@sunchao
Copy link
Member

sunchao commented Jan 5, 2021

I think we just need to verify that the combination of Hive 2.3.8/Parquet 1.11.1/Avro 1.10.1 works for Spark before sending out a vote. @heuermh have you got a chance to try it out? Thanks.

@heuermh
Copy link

heuermh commented Jan 6, 2021

@sunchao With the changes in bigdatagenomics/adam#2289 to remove various workarounds, the combination in pull request apache/spark#30517 works for us.

@sunchao
Copy link
Member

sunchao commented Jan 6, 2021

Thanks @heuermh ! I'll start a vote on Hive 2.3.8 soon.

@github-actions
Copy link

github-actions bot commented Mar 8, 2021

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Feel free to reach out on the dev@hive.apache.org list if the patch is in need of reviews.

@github-actions github-actions bot added the stale label Mar 8, 2021
@github-actions github-actions bot closed this Mar 16, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants