Skip to content

Fix RDDOperationScope serialization issues #379

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
Jun 5, 2018
Merged

Conversation

robert3005
Copy link

Since we bumped jackson in #359 we have been having non deterministic serialization issues with RDDOperationScope. All issues indicate that it can't find the serializer for the Option (parent variable) and serializes it using defaults. This force jackson to use static typing, i.e. use the class types and not values determined using reflection at runtime

@robert3005
Copy link
Author

I couldn't reproduce it in any unit/small scale test. I tested this against internal applications and couldn't reproduce issue across tens of builds

@robert3005 robert3005 merged commit 7522b5f into master Jun 5, 2018
@robert3005 robert3005 deleted the rk/case-class branch June 5, 2018 03:45
robert3005 added a commit that referenced this pull request Jun 24, 2018
Follow up to jackson 2.9.5 upgrade where RDDOperationScope can't find the serializer for the Option (parent variable) and serializes it using defaults. This force jackson to use static typing, i.e. use the class types and not values determined using reflection at runtime
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant