Skip to content

[benchmark_app] Keep every averaged profiling counter without mutating requests - #38923

Draft
zorox06 wants to merge 1 commit into
openvinotoolkit:masterfrom
zorox06:fix/benchmark-average-counters
Draft

zorox06 wants to merge 1 commit into
openvinotoolkit:masterfrom
zorox06:fix/benchmark-average-counters

Conversation

@zorox06

@zorox06 zorox06 commented Oct 16, 2026 •

Copy link
Copy Markdown

Details

The average JSON report keeps only the first layer because each averaged node is passed as a separate request and only request zero is serialized. Both JSON and CSV averaging also modify the original ProfilingInfo objects. Share an aggregator that builds new counters, then serialize every averaged layer as one request.

Tests cover Two-layer JSON and CSV averages, totals, metadata, unchanged source timings, repeatable report generation, an empty request and reordered layers.

Validation

  • 3 regression tests passed against this branch.
  • Windows, Python 3.12.14, OpenVINO 2026.4.1 runtime wheel, NumPy 2.4.2.
  • git diff --check passed.

Run the regression tests with the matching OpenVINO runtime installed:

PYTHONPATH=tools/benchmark_tool python -m pytest tools/benchmark_tool/unit_tests/test_average_counters.py -q

AI Assistance

AI assistance used: yes, for implementation and regression testing.

@github-actions github-actions Bot added the category: tools OpenVINO C++ / Python tools label Oct 16, 2026
@sys-openvino-ci sys-openvino-ci added the ExternalPR External contributor label Oct 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

category: tools OpenVINO C++ / Python tools ExternalPR External contributor

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants