Skip to content

Use DD exporter's sending queue instead of the batch processor #2263

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
dd-mergequeue merged 5 commits into from
Jan 6, 2026
Merged

Use DD exporter's sending queue instead of the batch processor #2263

dd-mergequeue merged 5 commits into from
Jan 6, 2026

Conversation

@agagniere
Copy link
Contributor

@agagniere agagniere commented Dec 22, 2025 •
edited
Loading

What this PR does / why we need it:

The OTel batch processor is no longer needed, as the batching logic can be done in the DD exporter directly.

Which issue this PR fixes

OTAGENT-764

Checklist

[Place an '[x]' (no spaces) in all applicable fields. Please remove unrelated fields.]

  • Chart Version semver bump label added (use <chartName>/minor-version, <chartName>/patch-version, or <chartName>/no-version-bump)
  • For datadog or datadog-operator chart or value changes, update the test baselines (run: make update-test-baselines)

GitHub CI takes care of the below, but are still required:

  • Documentation has been updated with helm-docs (run: .github/helm-docs.sh)
  • CHANGELOG.md has been updated

@agagniere agagniere requested review from a team as code owners December 22, 2025 17:11
@agagniere agagniere requested a review from ogaca-dd December 22, 2025 17:11
@github-actions github-actions bot added documentation Improvements or additions to documentation chart/datadog This issue or pull request is related to the datadog chart labels Dec 22, 2025
@agagniere agagniere changed the title Use DD exporter Use DD exporter's sending queue instead of the batch processor Dec 22, 2025
@agagniere agagniere marked this pull request as draft December 22, 2025 17:12
@agagniere agagniere self-assigned this Dec 22, 2025
@agagniere agagniere added datadog/minor-version Minor version bump for datadog chart and removed datadog/minor-version Minor version bump for datadog chart labels Dec 22, 2025
@agagniere agagniere force-pushed the agagniere/ddbatchqueue branch from 0a2b464 to 7e1cb6e Compare December 22, 2025 17:24
@agagniere agagniere added the datadog/patch-version Patch version bump for datadog chart label Dec 22, 2025
@agagniere agagniere requested review from songy23 and removed request for ogaca-dd December 22, 2025 17:35
@agagniere agagniere marked this pull request as ready for review December 22, 2025 18:19
songy23
songy23 reviewed Dec 22, 2025
View reviewed changes
@songy23
Copy link
Member

songy23 commented Dec 22, 2025

The batch processor is kept for the Daemonset agent when it forwards its telemetry to the gateway via the OTLP exporter

You can replace the batch processor with sending queue in OTLP exporter too

@agagniere agagniere force-pushed the agagniere/ddbatchqueue branch from 9fd0504 to 1b49a8c Compare December 29, 2025 14:29
@agagniere agagniere requested a review from songy23 December 30, 2025 13:11
songy23
songy23 reviewed Dec 30, 2025
View reviewed changes
@agagniere
Copy link
Contributor Author

agagniere commented Jan 5, 2026

/merge

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Jan 5, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-05 17:32:10 UTC ℹ️ Start processing command /merge

2026-01-05 17:32:16 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-01-05 20:44:11 UTC ⚠️ MergeQueue: This merge request was unqueued

antoine.gagniere@datadoghq.com unqueued this merge request

@agagniere
Copy link
Contributor Author

agagniere commented Jan 5, 2026

/remove

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Jan 5, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-05 20:44:06 UTC ℹ️ Start processing command /remove

2026-01-05 20:44:08 UTC ℹ️ Devflow: /remove

@agagniere agagniere force-pushed the agagniere/ddbatchqueue branch from cee08b7 to a1c095f Compare January 6, 2026 12:30
@agagniere
Copy link
Contributor Author

agagniere commented Jan 6, 2026

/merge

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Jan 6, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-06 12:30:15 UTC ℹ️ Start processing command /merge

2026-01-06 12:30:21 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 50m (p90).

2026-01-06 12:30:28 UTC ❌ MergeQueue: This merge request was updated

This PR is rejected because it was updated

@dd-octo-sts
chore: update charts
bad70e2 
- bump version for datadog to 3.158.1 (patch-version)
- update changelog for datadog with version 3.158.1
- update readme for datadog
@agagniere
Copy link
Contributor Author

agagniere commented Jan 6, 2026

/merge

@dd-devflow-routing-codex
Copy link

dd-devflow-routing-codex bot commented Jan 6, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-01-06 12:30:52 UTC ℹ️ Start processing command /merge

2026-01-06 12:30:56 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in main is approximately 50m (p90).

2026-01-06 13:10:46 UTC ℹ️ MergeQueue: This merge request was merged

@dd-mergequeue dd-mergequeue bot merged commit d295beb into main Jan 6, 2026
40 checks passed
@dd-mergequeue dd-mergequeue bot deleted the agagniere/ddbatchqueue branch January 6, 2026 13:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@songy23 songy23 songy23 approved these changes

@khewonc khewonc khewonc approved these changes

Assignees

@agagniere agagniere

Labels

chart/datadog This issue or pull request is related to the datadog chart datadog/patch-version Patch version bump for datadog chart documentation Improvements or additions to documentation mergequeue-status: done

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@agagniere @songy23 @khewonc