Skip to content

docs(framework-context): distinguish Container benchmark load from threshold regressions - #3499

Merged
kang-heewon merged 1 commit into
trunkfrom
fix/3435-container-benchmark
Oct 11, 2026
Merged

kang-heewon merged 1 commit into
trunkfrom
fix/3435-container-benchmark

Conversation

@kang-heewon

@kang-heewon kang-heewon commented Oct 11, 2026 •

Copy link
Copy Markdown
Member

Closes #3435.

The Container threshold failures reproduce locally during concurrent repository checks. Four independent benchmark runs, including a fresh run at the exact investigation commit, pass all 17 rows with unchanged measurement and gate inputs. The note records the workload, raw outcomes, baseline advisories, and triage boundaries so those failures can be assessed without increasing limits or discarding evidence.

Registration and validation p75 in the exact-commit run are 2.983 ms and 3.371 ms, below even the local 10/20 ms limits. Local attempts remain failed: registration 16.166/19.044 ms; validation 16.211/39.942 ms. A separate CPU diagnostic demonstrates off-CPU delays, but the precise cause of the earlier failures remains unresolved. This does not claim a local transient pass or runtime repair.

Validation

  • Lightweight profile: prose-only troubleshooting note and empty changeset; no runtime, benchmark, threshold, baseline, manifest, or workflow change.
  • Source, measurement, gate-input and linked-artifact comparisons verified; independent evidence/documentation review: PASS.
  • Formatting and changeset validation: PASS. Static PR Companion: PASS, with no applicable executable gate.
  • Normal pre-push hook: full tests 311/311 tasks and guarded full typecheck 328/328 tasks passed; tracked files unchanged. Package concurrency was limited to one. The original browser test also passed 3/3 in isolation after an initial 30-second child-process timeout; its code and deadline were unchanged.

Head: 86caf43bf0df8679116adf6caa4916d1ee535ebc
Validated base: 0e786bfbddf6cd983e1e62d88ed0f30d6d2aee9e.

Integration validation

All four required checks pass: benchmark-gate, docs-sync-check, repository-contracts, and validate. CI 38132382432 also passes core verification, generated apps, package artifacts, coverage/security, docs build, and split validation. Benchmark gate 38132382419 and companion 38132382562 pass. The CI checkout identity is verified as candidate 1e840215891e8e61fa7417c3a785249f515cb0eb, base 4d3b429eff1cbe0ecd3442154f971a77a4155341, and unchanged head 86caf43bf0df8679116adf6caa4916d1ee535ebc.

The earlier independent registry failure was resolved by #3502. The first reopened run still inspected the old candidate; its failures remain preserved and are superseded by the verified current-candidate result above.

Current base: a6ce270e5cc1c766891baf860b0a581eb3b20ba9. Cumulative drift includes the registry source-location repair, QStash failure-recording error preservation, and admin-generated null literal handling. None interacts with the benchmark workload, gates, or investigation findings. Existing head evidence remains applicable; later drift has been assessed for compatibility without claiming it was covered by the earlier CI checkout. No rebase or authored-source change was needed. No requested changes, unresolved review threads, or blocking issue comments remain.

Copilot AI balanced review requested due to automatic review settings October 11, 2026 05:45

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@coderabbitai

coderabbitai Bot commented Oct 11, 2026

Copy link
Copy Markdown

Warning

Review limit reached

You've used all free OSS reviews for now. Wait for the free limit to reset to keep reviewing this public repository.

Next included review available in 59 minutes.

Check out review usage here.

View limit details

Limit details: You’ve used the included review currently available.

Learn how review limits work.

Review configuration:

⚙️ Run configuration
  • Configuration used: Organization UI
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: e0139912-1c7d-44a4-b5ac-a52fb30452f2

📥 Commits

Reviewing files that changed from the base of the PR and between 0e786bf and 86caf43.


📒 Files selected for processing (2)
  • .changeset/container-benchmark-investigation.md
  • docs/troubleshooting/container-benchmarks.md

  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@kang-heewon kang-heewon reopened this Oct 11, 2026
@kang-heewon kang-heewon reopened this Oct 11, 2026
@kang-heewon
kang-heewon merged commit 05aa21b into trunk Oct 11, 2026
50 of 57 checks passed
@kang-heewon
kang-heewon deleted the fix/3435-container-benchmark branch October 11, 2026 11:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[framework-context] Container registration benchmarks exceed repository verification thresholds on unchanged source

2 participants