Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for blocking OTel-Arrow pipeline #11

Closed
jmacd opened this issue Aug 16, 2023 · 0 comments · Fixed by #93
Closed

Support for blocking OTel-Arrow pipeline #11

jmacd opened this issue Aug 16, 2023 · 0 comments · Fixed by #93

Comments

@jmacd
Copy link
Contributor

jmacd commented Aug 16, 2023

The otelarrow exporter uses the exporterhelper, a common component from OpenTelemetry Collector-core. The exporterhelper does not support back-pressure, instead of drops data or returns immediately to the user.

We are tracking these issues:
open-telemetry/opentelemetry-collector#8245
open-telemetry/opentelemetry-collector#8122
@jmacd jmacd mentioned this issue Nov 10, 2023
Merged
@jmacd jmacd closed this as completed in #93 Nov 17, 2023
jmacd added a commit that referenced this issue Nov 17, 2023
@moh-osman3 @jmacd
(concurrentbatchprocessor): add in-flight byte limit to producer queue (
f2d291d 
#93)

This PR adds a new config option in the `concurrentbatchprocessor` named
`max_in_flight_bytes`. This config option will be used by processor to
control admission (using a semaphore) into the producer queue based on
the size of requests.

Fixes #80.
Fixes #11.

---------

Co-authored-by: Joshua MacDonald <jmacd@users.noreply.github.com>
@jmacd jmacd mentioned this issue Nov 17, 2023
Merged
jmacd added a commit that referenced this issue Nov 17, 2023
@jmacd
Release v0.10.0 with new batch processor (#107)
b51a4c6 
Releasing fixes for #11, #80.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

(concurrentbatchprocessor): add in-flight byte limit to producer queue moh-osman3/otel-arrow
1 participant
@jmacd