Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix reactor upgrade issue with bulk #20083

Conversation

moderakh
Copy link
Contributor

@moderakh moderakh commented Mar 24, 2021

merging master to feature branch brought reactor upgrade and we are constantly getting this error on bulk

reactor.core.Exceptions$OverflowException: Backpressure overflow during Sinks.Many#emitNext

EmitterProcessor that we used in Spark for integrating against bulk is deprecated in the newer version of reactor and seems its behaviour has changed.

replacing EmitterProcessor with Sinks.many() seems to be the recommended path forward and solved the problem.

There are also many deprecated apis of reactor-core which are used in bulk implementation in the core sdk. I suspect later we have to fix those as well.

Copy link
Member

@FabianMeiswinkel FabianMeiswinkel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@moderakh moderakh merged commit bd0e074 into Azure:feature/cosmos/spark30 Mar 24, 2021
@moderakh moderakh deleted the users/moderakh/reactor-upgrade-fix branch March 24, 2021 16:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants