Skip to content

chore(ci): use a 600s system-tests scheduling budget - #6447

Merged
cgcote merged 4 commits into
masterfrom
codex/system-tests-600s-experiment
Oct 9, 2026
Merged

cgcote merged 4 commits into
masterfrom
codex/system-tests-600s-experiment

Conversation

@cgcote

@cgcote cgcote commented Oct 8, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do?

Raises the Ruby system-tests scheduling target from 300 to 600 seconds.

Pins system-tests to 52cecf6f2c74f3d41e57e4352cf41daf0f7a51b5, which refreshes the Ruby p75 timing estimates used to balance end-to-end shards.

Motivation:

The 300-second target is shorter than several Ruby weblog build estimates and leaves too little execution budget for their scenarios.

The refreshed estimates and 600-second target reduce the workflow's long tail:

Metric Previous run Updated run Change
Total workflow duration 22m33s 15m41s 30.5% faster
End-to-end shards 249 256 +7
p75 shard duration 6m35s 5m52s 10.9% faster
p90 shard duration 8m13s 6m30s 20.9% faster
Slowest shard 15m54s 10m35s 33.4% faster
Shards over 600 seconds 16 12 25% fewer

The remaining shards over the target finished within 35 seconds of it, indicating substantially better scheduling balance.

Change log entry

None. This is an internal CI scheduling change.

Additional Notes:

The pinned system-tests commit is merged into DataDog/system-tests's main branch, as confirmed by the workflow guard.

How to test the change?

The updated run completed successfully.

@cgcote cgcote added the AI Generated Largely based on code generated by an AI or LLM. This label is the same across all dd-trace-* repos label Oct 8, 2026
@dd-octo-sts dd-octo-sts Bot added the dev/github Github repository maintenance and automation label Oct 8, 2026
@datadog-prod-us1-4

datadog-prod-us1-4 Bot commented Oct 8, 2026 •

Copy link
Copy Markdown

Tests

✅ All CI checks and tests passed.

🎉 All green!

🧪 All tests passed
❄️ No new flaky tests detected

🎯 Code Coverage (details)
• Patch Coverage: 100.00%
• Overall Coverage: 90.65% (-0.01%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: c9d842b | Docs | View more details | Give us feedback!

@cgcote cgcote changed the title chore(ci): test a 600s system-tests scheduling budget chore(ci): use a 600s system-tests scheduling budget Oct 9, 2026
@cgcote
cgcote marked this pull request as ready for review October 9, 2026 09:48
@cgcote
cgcote requested a review from a team as a code owner October 9, 2026 09:48
@cgcote
cgcote requested review from lloeki and removed request for a team October 9, 2026 09:48
@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 9, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-09T09:50:28.040563Z c9d842b Draft marked ready
🔒 Security Review ✅ Completed 2026-10-09T09:52:29.007544Z c9d842b Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@datadog-prod-us1-4 datadog-prod-us1-4 Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Bits Code Review: PASS

More details

The 600-second scheduling target preserves the expected numeric input, and the reusable workflow and checkout pins match. Independent verification of the linked CI runs was blocked by GitHub HTTP 403.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Bits Code Review · Commit c9d842b · @DataDog review to ask questions

@eregon eregon left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@cgcote
cgcote merged commit 3749626 into master Oct 9, 2026
617 checks passed
@cgcote
cgcote deleted the codex/system-tests-600s-experiment branch October 9, 2026 10:44
@dd-octo-sts dd-octo-sts Bot added this to the 2.45.0 milestone Oct 9, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

AI Generated Largely based on code generated by an AI or LLM. This label is the same across all dd-trace-* repos dev/github Github repository maintenance and automation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants