Skip to content

Conversation

@kenzieschmoll
Copy link
Member

This adds p50, p90, and p95 computations to each benchmark metric. This PR also refactors the benchmark computation definitions so they are defined by an enum.

Fixes flutter/flutter#151551.

@kenzieschmoll kenzieschmoll added the override: no versioning needed Override the check requiring version bumps for most changes label Oct 2, 2024
@kenzieschmoll kenzieschmoll added the autosubmit Merge PR when tree becomes green via auto submit App label Oct 2, 2024
Copy link
Contributor

@yjbanov yjbanov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@kenzieschmoll kenzieschmoll removed the autosubmit Merge PR when tree becomes green via auto submit App label Oct 2, 2024
@kenzieschmoll kenzieschmoll merged commit cff1e5f into flutter:main Oct 2, 2024
@kenzieschmoll kenzieschmoll deleted the percentiles branch October 2, 2024 22:39
@kenzieschmoll kenzieschmoll changed the title Add percentile computations to benchmark scores [web_benchmarks] Add percentile computations to benchmark scores Oct 2, 2024
engine-flutter-autoroll added a commit to engine-flutter-autoroll/flutter that referenced this pull request Oct 3, 2024
engine-flutter-autoroll added a commit to engine-flutter-autoroll/flutter that referenced this pull request Oct 3, 2024
auto-submit bot pushed a commit to flutter/flutter that referenced this pull request Oct 3, 2024
flutter/packages@7c97c88...429650f

2024-10-03 34871572+gmackall@users.noreply.github.com [camera, google_sign_in, espresso] Bump guava to version `33.3.1`. (flutter/packages#7773)
2024-10-03 stuartmorgan@google.com [video_player] Remove -Werror from Android build (flutter/packages#7776)
2024-10-03 echo.ellet@gmail.com [pigeon] chore(readme): deprecated command of running pigeon (flutter/packages#7761)
2024-10-02 49699333+dependabot[bot]@users.noreply.github.com [image_picker]: Bump androidx.activity:activity from 1.9.1 to 1.9.2 in /packages/image_picker/image_picker_android/android (flutter/packages#7607)
2024-10-02 43759233+kenzieschmoll@users.noreply.github.com Add percentile computations to benchmark scores (flutter/packages#7760)
2024-10-02 stuartmorgan@google.com [various] Unpin some dev dependencies (flutter/packages#7762)

If this roll has caused a breakage, revert this CL and stop the roller
using the controls here:
https://autoroll.skia.org/r/flutter-packages-flutter-autoroll
Please CC flutter-ecosystem@google.com on the revert to ensure that a human
is aware of the problem.

To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose

To report a problem with the AutoRoller itself, please file a bug:
https://issues.skia.org/issues/new?component=1389291&template=1850622

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

override: no versioning needed Override the check requiring version bumps for most changes p: web_benchmarks

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[web_benchmarks] record Flutter frame timings with benchmark runs

2 participants