Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/20459 sub steps refactor #51231

Merged
merged 55 commits into from
Oct 29, 2024

Conversation

burczu
Copy link
Contributor

@burczu burczu commented Oct 22, 2024

Details

In this PR I've refactored some parts of the code related to sub-steps forms that we recently use more extensively in the App. These improvements was discussed with @koko57 and @MrMuzyk - it will be useful in the Global Reimbursement project where we create more sub-steps forms. The PR introduces few re-usable common form components like FullNameStep, DateOfBirthStep, AddressStep or SingleFieldStep (that can be used for e.g. phone numbers or social security numbers) ones and uses them wherever applicable. It also makes the InteractiveStepWrapper component more re-usable.

Fixed Issues

$ #50893
PROPOSAL: n/a

Tests

Enable payments:

  1. Log in to the App
  2. Go to Settings -> Wallet
  3. Add bank account
  4. Click "Enable wallet"
  5. Test all the "Personal info" steps linke full name, address, date of birth

Reimbursement account - personal info:

  1. Log in to the App
  2. Create new workspace
  3. Add new member
  4. Go to More features section and enable Expensify Card option
  5. Go to Expensify Card section that just appeared
  6. Tap Issue new card
  7. Go through the process of connecting to the bank account etc. (use testing data described in this Slack thread: https://callstack-hq.slack.com/archives/C01GTK53T8Q/p1711049879962529)
  8. At some point of the process you'll need to provide requestor information like first and last name, date of birth etc. - test if it works correctly

Reimbursement account - beneficial owner info:

  1. Repeat steps 1-7 described above
  2. On the later steps of the process, you'll be asked: "Do you own 25% or more of Alberta Bobbeth Charleson?" - select "No"
  3. On the next step: "Do any individuals own 25% or more of Alberta Bobbeth Charleson?" - select "Yes"
  4. You'll land on the next personal info multiple steps form - test it if it works correctly

Missing personal info for issuing the card:

  1. Log in to the App as User A
  2. Go to the Workspace that you are admin of
  3. Invite completely new user (User B)
  4. Turn on Expensify Card for this workspace if not done yet
  5. Set it up
  6. Tap "Issue new card" and issue the card for User B
  7. Log in to the App as User B
  8. Go to the Workspace chat - you should see the "Add shipping details" button - tap it
  9. You'll see the multiple step form asking you to fill your personal details - test it
  • Verify that no errors appear in the JS console

Offline tests

Same as above

QA Steps

Same as above

  • Verify that no errors appear in the JS console

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I verified the translation was requested/reviewed in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native

Enable payments:

Screen.Recording.2024-10-24.at.09.02.09.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.09.10.28.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.09.13.44.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.09.18.03.mov
Android: mWeb Chrome

Enable payments:

Screen.Recording.2024-10-24.at.10.32.27.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.10.40.06.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.10.43.18.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.10.36.08.mov
iOS: Native

Enable payments:

Screen.Recording.2024-10-24.at.08.27.37.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.08.31.24.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.08.36.38.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.08.45.54.mov
iOS: mWeb Safari

Enable payments:

Screen.Recording.2024-10-24.at.09.41.31.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.10.15.04.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.10.24.29.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.09.50.48.mov
MacOS: Chrome / Safari

Enable payments:

Screen.Recording.2024-10-23.at.09.31.28.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.07.27.46.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.07.45.42.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.07.51.18.mov
MacOS: Desktop

Enable payments:

Screen.Recording.2024-10-24.at.08.03.18.mov

Reimbursement account - personal info:

Screen.Recording.2024-10-24.at.08.06.26.mov

Reimbursement account - beneficial owner info:

Screen.Recording.2024-10-24.at.08.09.56.mov

Missing personal info for issuing the card:

Screen.Recording.2024-10-24.at.08.13.40.mov

@burczu
Copy link
Contributor Author

burczu commented Oct 28, 2024

@burczu Is it expected that we should navigate to Connect Bank Account page on pressing back?

I think so. Also, I don't think I've touched this behaviour while working on refactor.

@burczu
Copy link
Contributor Author

burczu commented Oct 28, 2024

Bug: In Personal Info, while entering invalid zipcode and press Submit, error is shown at address field.

Right, that was a bug - fixed now. Thanks

@hungvu193
Copy link
Contributor

Bug: In Personal Info, while entering invalid zipcode and press Submit, error is shown at address field.

Right, that was a bug - fixed now. Thanks

Cool. Can you merge main? I'll verify in few miunutes

@burczu
Copy link
Contributor Author

burczu commented Oct 28, 2024

Cool. Can you merge main? I'll verify in few miunutes

done

@hungvu193
Copy link
Contributor

For some reason I can't seem to text on simulator :/, recording screenshots for all platforms will take more time than I expected

@hungvu193
Copy link
Contributor

hungvu193 commented Oct 29, 2024

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Screen.Recording.2024-10-29.at.09.50.29.mov
Android: mWeb Chrome
Screen.Recording.2024-10-29.at.09.25.39.mov
iOS: Native
Screen.Recording.2024-10-28.at.17.48.54.mov
iOS: mWeb Safari
Screen.Recording.2024-10-28.at.17.50.37.mov
MacOS: Chrome / Safari
Screen.Recording.2024-10-28.at.10.46.16.mov
Screen.Recording.2024-10-28.at.09.48.32.mov
Screen.Recording.2024-10-28.at.13.56.19.mov
MacOS: Desktop
Screen.Recording.2024-10-28.at.14.15.04.mov

@melvin-bot melvin-bot bot requested a review from madmax330 October 29, 2024 02:51
@hungvu193
Copy link
Contributor

@burczu Sorry, I forgot the physical back button press on Android. Do you think we also need to handle it? Please take a look at the video below, if we press Back button, the screen will be existed instead of navigating to previous step.

Screen.Recording.2024-10-29.at.11.09.52.mov

@burczu
Copy link
Contributor Author

burczu commented Oct 29, 2024

@burczu Sorry, I forgot the physical back button press on Android. Do you think we also need to handle it? Please take a look at the video below, if we press Back button, the screen will be existed instead of navigating to previous step.

Hmm... I think this ineed might be a bug, but I don't think it is related to this refactor - I did not touch this kind logic here.

@hungvu193
Copy link
Contributor

I see. Then I think we're good to go here 👍

@OSBotify
Copy link
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

Copy link
Contributor

🚀 Deployed to staging by https://github.com/madmax330 in version: 9.0.55-1 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 failure ❌
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 cancelled 🔪
🍎🔄 iOS HybridApp 🍎🔄 failure ❌

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Oct 29, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Open search router TTI Open Search Router TTI 502.926 ms → 656.818 ms (+153.892 ms, +30.6%) 🔴
Show details
Name Duration
Open search router TTI Open Search Router TTI Baseline
Mean: 502.926 ms
Stdev: 59.700 ms (11.9%)
Runs: 374.82076100073755 385.58699500001967 385.6722829993814 392.4315189998597 400.0578209999949 402.55948900058866 403.99153700098395 405.61710700020194 449.06730199977756 452.54687600024045 458.62312800064683 459.918863998726 467.84183800034225 467.84346600063145 469.89563000015914 472.1832689996809 472.5043539982289 473.8868410009891 476.4323740005493 476.9514569994062 478.2910560015589 480.4466559998691 480.60453299991786 481.671996999532 485.7585040014237 486.23396900109947 488.8498940002173 492.37137899920344 496.28564499877393 506.844239000231 507.0925699993968 507.84179700165987 525.7575280014426 530.840331999585 531.773072000593 536.8566079996526 539.2626550011337 540.703694999218 540.9279789999127 541.0498050004244 541.6032720003277 544.0605880003422 545.7270919997245 545.8037119992077 546.031576000154 549.8249099999666 553.4548339992762 555.0178629998118 556.3673099987209 558.016031999141 565.4516200013459 565.4558520000428 565.469645999372 566.2751059997827 572.3936769999564 579.9409179985523 585.3387449998409 607.5303959995508 640.9602060001343

Current
Mean: 656.818 ms
Stdev: 23.235 ms (3.5%)
Runs: 591.5027259998024 610.9274090006948 617.343586999923 619.3040360007435 621.780965000391 624.2322599999607 624.4903980009258 626.2169599998742 634.5060230009258 635.1299240011722 636.871255999431 638.6114910002798 639.5775150004774 640.0573730003089 640.6006670016795 644.2448730003089 644.8682049997151 645.2269289996475 646.8653159998357 650.2109379991889 650.3712159991264 650.4333089999855 651.0588790010661 651.5986330006272 654.6621499992907 655.9011640008539 656.2336430009454 657.2292080000043 658.4989019986242 658.9796149991453 659.1366779990494 659.5671790000051 660.0062669999897 661.1898200009018 662.0469979997724 663.9814860001206 664.1175130009651 667.5592049993575 668.7117110006511 669.7852789983153 670.6904710009694 671.8660479988903 673.4391280002892 673.6043299995363 675.253581000492 675.289145000279 675.73168999888 675.987630000338 676.2721360009164 678.7723799999803 680.3834640011191 686.1002610009164 687.2729090005159 687.3073330000043 688.8191330004483 693.3883870001882 696.924886001274 714.6822919994593

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunch 32.088 ms → 25.879 ms (-6.208 ms, -19.3%) 🟢
App start time nativeLaunchEnd_To_appCreationStart 48.250 ms → 63.356 ms (+15.106 ms, +31.3%) 🟡
App start time appCreationEnd_To_contentAppeared 509.534 ms → 532.086 ms (+22.552 ms, +4.4%)
App start time runJsBundle 361.433 ms → 377.450 ms (+16.017 ms, +4.4%)
App start time TTI 1182.572 ms → 1217.198 ms (+34.626 ms, +2.9%)
App start time contentAppeared_To_screenTTI 529.998 ms → 524.848 ms (-5.151 ms, -1.0%)
App start time appCreation 60.600 ms → 66.390 ms (+5.790 ms, +9.6%)
App start time regularAppStart 0.019 ms → 0.020 ms (+0.001 ms, +4.6%)
App start time (CPU) 146.664 % → 146.707 % (+0.044 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 374.683 MB → 369.625 MB (-5.058 MB, -1.3%)
App start time (CPU/JS) 80.016 % → 79.707 % (-0.309 %, ±0.0%)
App start time (CPU/UI) 27.576 % → 27.358 % (-0.218 %, -0.8%)
Open search router TTI Load Search Options 105.455 ms → 99.895 ms (-5.560 ms, -5.3%)
Open search router TTI (CPU) 131.652 % → 133.129 % (+1.477 %, +1.1%)
Open search router TTI (FPS) 60.000 FPS → 60.000 FPS
Open search router TTI (RAM) 381.330 MB → 385.562 MB (+4.232 MB, +1.1%)
Open search router TTI (CPU/JS) 70.477 % → 75.235 % (+4.758 %, +6.8%)
Open search router TTI (CPU/UI) 25.062 % → 23.322 % (-1.740 %, -6.9%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 390.782 ms → 387.942 ms (-2.840 ms, -0.7%)
Report typing (CPU) 98.600 % → 98.598 % (-0.002 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 507.163 MB → 505.309 MB (-1.854 MB, ±0.0%)
Report typing (CPU/JS) 50.803 % → 50.603 % (-0.200 %, ±0.0%)
Report typing (CPU/UI) 22.211 % → 22.031 % (-0.180 %, -0.8%)
Chat opening Chat opening 134.974 ms → 135.192 ms (+0.218 ms, ±0.0%)
Chat opening Chat TTI 395.344 ms → 394.472 ms (-0.872 ms, ±0.0%)
Chat opening (CPU) 134.507 % → 132.981 % (-1.525 %, -1.1%)
Chat opening (FPS) 60.000 FPS → 60.000 FPS
Chat opening (RAM) 378.716 MB → 371.077 MB (-7.639 MB, -2.0%)
Chat opening (CPU/JS) 72.017 % → 72.125 % (+0.108 %, ±0.0%)
Chat opening (CPU/UI) 24.885 % → 24.703 % (-0.181 %, -0.7%)
Linking (CPU) 143.927 % → 144.827 % (+0.900 %, +0.6%)
Linking (FPS) 60.000 FPS → 60.000 FPS
Linking (RAM) 422.079 MB → 424.644 MB (+2.565 MB, +0.6%)
Linking (CPU/JS) 80.007 % → 80.859 % (+0.852 %, +1.1%)
Linking (CPU/UI) 24.995 % → 25.363 % (+0.368 %, +1.5%)
Linking 214.762 ms → 218.243 ms (+3.481 ms, +1.6%)
Show details
Name Duration
App start time nativeLaunch Baseline
Mean: 32.088 ms
Stdev: 2.312 ms (7.2%)
Runs: 28 28 29 29 29 29 29 30 30 30 30 30 30 30 31 31 31 31 31 31 31 31 31 31 31 31 31 32 32 32 32 32 32 32 32 33 33 33 33 33 34 34 34 34 34 34 34 34 34 34 34 35 36 36 37 38 38

Current
Mean: 25.879 ms
Stdev: 2.948 ms (11.4%)
Runs: 21 21 21 22 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 24 25 25 25 25 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 27 27 27 27 27 28 28 29 29 29 30 30 31 31 32 32 32 33
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 48.250 ms
Stdev: 6.650 ms (13.8%)
Runs: 35 39 39 40 40 41 41 41 41 41 42 42 43 43 43 43 44 44 46 46 46 46 46 46 46 47 47 47 47 47 47 47 48 48 48 48 48 49 49 50 50 50 50 50 52 53 53 53 53 54 54 56 56 56 57 59 61 64 66 67

Current
Mean: 63.356 ms
Stdev: 7.490 ms (11.8%)
Runs: 51 52 53 54 55 55 55 55 56 57 57 57 57 57 58 58 58 59 59 59 59 60 60 60 61 61 61 61 61 62 62 62 62 63 63 63 63 64 64 65 66 66 67 69 69 69 69 70 72 72 72 72 74 74 77 79 79 80 83
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 509.534 ms
Stdev: 23.428 ms (4.6%)
Runs: 469 470 473 475 478 481 482 486 487 488 488 488 489 490 490 490 491 492 493 493 495 497 498 503 505 505 507 507 509 509 510 513 513 514 515 517 517 518 521 522 522 524 524 524 529 529 531 531 532 532 533 535 535 538 550 562 562 572

Current
Mean: 532.086 ms
Stdev: 22.682 ms (4.3%)
Runs: 492 492 495 495 498 500 502 503 508 514 514 516 516 519 521 521 522 522 523 524 525 526 526 527 527 527 529 529 529 530 530 531 531 532 532 535 536 536 538 538 538 539 542 543 547 549 550 552 552 553 555 560 563 572 573 584 588 590
App start time runJsBundle Baseline
Mean: 361.433 ms
Stdev: 21.393 ms (5.9%)
Runs: 332 332 335 336 336 337 340 341 341 341 342 342 343 343 344 344 344 344 345 345 346 346 346 347 348 350 352 353 354 354 354 356 357 357 357 360 364 367 372 372 373 373 375 377 380 381 382 387 388 389 390 391 392 392 393 396 399 401 402 406

Current
Mean: 377.450 ms
Stdev: 21.477 ms (5.7%)
Runs: 345 346 350 351 352 352 353 354 356 357 357 360 361 361 361 362 362 363 365 365 366 366 366 367 370 370 372 372 372 373 373 374 374 375 376 376 376 377 378 379 380 383 384 388 388 393 393 396 397 405 406 407 408 408 410 413 420 424 429 430
App start time TTI Baseline
Mean: 1182.572 ms
Stdev: 37.229 ms (3.1%)
Runs: 1100.0373580008745 1102.8760129995644 1105.877647999674 1127.5664850007743 1129.845300000161 1133.5542329996824 1136.619263999164 1136.973544999957 1145.5392279997468 1147.1179590001702 1147.7209189999849 1147.7742580007762 1149.1810810007155 1152.0355730000883 1152.751473000273 1156.1001779995859 1159.5226189997047 1159.9694200009108 1163.7820779997855 1163.8444539997727 1166.2220619991422 1166.3905469998717 1166.715113999322 1167.5880319997668 1177.3777590002865 1178.150402000174 1180.6675499994308 1180.8414210006595 1181.4930750001222 1187.4845119994134 1188.815354000777 1191.7772439997643 1191.9611409995705 1192.62229100056 1195.201737999916 1196.2243520002812 1196.2865639999509 1201.3908500000834 1203.4325939994305 1204.826737999916 1205.3958880007267 1205.683946000412 1206.0440580006689 1208.1103939991444 1209.8247769996524 1216.4157609995455 1216.4551270008087 1217.3209990002215 1218.0125169996172 1219.1447260007262 1219.5049290005118 1220.5958259999752 1225.9095140006393 1227.0602439995855 1228.0605539996177 1228.976399000734 1240.772644000128 1244.240244999528 1280.0422089993954

Current
Mean: 1217.198 ms
Stdev: 33.981 ms (2.8%)
Runs: 1143.8571390006691 1162.1868179999292 1163.976476000622 1164.5915959998965 1164.8306889999658 1165.0054640006274 1173.1750099994242 1174.525460999459 1178.7252140007913 1181.764196999371 1184.07003399916 1192.2831539995968 1194.175528999418 1194.9509769994766 1195.5028530005366 1195.700626000762 1196.3793519996107 1201.7059189993888 1201.8049929998815 1201.8380679991096 1204.1288150008768 1207.4463609997183 1208.5274730008096 1208.6464970000088 1211.133337000385 1211.5513909999281 1213.234104000032 1214.6602480001748 1215.2715189997107 1215.5894549991935 1219.7139699999243 1220.8659940008074 1222.7312569990754 1225.8383629992604 1226.3928420003504 1228.8472160007805 1229.58575299941 1229.929770000279 1230.2796320002526 1231.6927209999412 1232.898907000199 1237.0717619992793 1239.392758000642 1241.036997999996 1241.8009409997612 1243.989551000297 1245.8722489997745 1246.489896999672 1248.6084310002625 1252.619326999411 1264.5265699997544 1264.56974699907 1269.416140999645 1276.3840629998595 1280.2122840005904 1292.5714490003884 1295.704399999231
App start time contentAppeared_To_screenTTI Baseline
Mean: 529.998 ms
Stdev: 33.029 ms (6.2%)
Runs: 457.0373580008745 461.56648500077426 465.8760129995644 481.84142100065947 482.8776479996741 483.5542329996824 489.22206199914217 494.03557300008833 499.10017799958587 499.6192639991641 499.7514730002731 500.7742580007762 504.37775900028646 507.84530000016093 508.9735449999571 509.1447260007262 512.4325939994305 512.6675499994308 513.5392279997468 514.7209189999849 515.8267379999161 520.9763990007341 522.3905469998717 523.2243520002812 523.3958880007267 527.1179590001702 527.8444539997727 530.4930750001222 532.1810810007155 535.6222910005599 535.7772439997643 539.1103939991444 539.5226189997047 540.0602439995855 540.9694200009108 542.0125169996172 542.2017379999161 542.3209990002215 544.2402449995279 544.2865639999509 546.4157609995455 546.6839460004121 548.4845119994134 554.3908500000834 555.1504020001739 556.9611409995705 558.5880319997668 559.815354000777 562.0605539996177 562.715113999322 565.0440580006689 569.9095140006393 570.8247769996524 571.5958259999752 594.5049290005118 596.4551270008087 621.7726440001279

Current
Mean: 524.848 ms
Stdev: 32.055 ms (6.1%)
Runs: 456.8571390006691 462.1868179999292 466.9764760006219 471.9319180008024 475.7223770003766 480.525460999459 484.0054640006274 485.7312569990754 487.52747300080955 488.07003399915993 494.6464970000088 495.700626000762 496.1750099994242 497.37935199961066 498.89890700019896 501.50285300053656 505.175528999418 507.5915959998965 508.7252140007913 511.76419699937105 512.58575299941 514.8306889999658 515.1288150008768 517.036997999996 517.6602480001748 519.9509769994766 522.0717619992793 522.8009409997612 525.8659940008074 526.929770000279 528.7059189993888 528.8049929998815 532.3840629998595 534.2831539995968 537.4463609997183 537.6927209999412 537.9895510002971 539.7139699999243 539.8380679991096 540.234104000032 543.2796320002526 543.5513909999281 544.8383629992604 544.8472160007805 546.3928420003504 548.1333370003849 549.2715189997107 549.5894549991935 553.6084310002625 555.4662250000983 555.619326999411 556.489896999672 564.8722489997745 568.416140999645 573.5265699997544 578.2122840005904 578.56974699907 579.5714490003884 602.7043999992311
App start time appCreation Baseline
Mean: 60.600 ms
Stdev: 6.711 ms (11.1%)
Runs: 49 51 52 52 52 52 53 53 53 53 53 54 55 55 55 55 55 55 56 56 57 57 57 58 58 58 58 58 59 59 60 61 61 61 62 63 63 64 64 64 64 64 64 64 65 65 65 66 66 67 67 69 69 69 70 71 73 75 75 77

Current
Mean: 66.390 ms
Stdev: 5.499 ms (8.3%)
Runs: 57 57 58 59 59 60 60 60 60 60 61 61 61 61 62 62 62 62 63 63 64 64 64 65 65 65 65 65 66 66 67 67 67 67 67 67 67 68 68 68 69 69 69 71 71 72 72 72 73 73 73 73 74 74 74 75 76 77 80
App start time regularAppStart Baseline
Mean: 0.019 ms
Stdev: 0.001 ms (4.9%)
Runs: 0.017253000289201736 0.01729399897158146 0.017496999353170395 0.01769999973475933 0.01782199926674366 0.017985999584197998 0.01822900027036667 0.01822900027036667 0.01827000081539154 0.01827000081539154 0.018310999497771263 0.018350999802350998 0.018350999802350998 0.018350999802350998 0.01839200034737587 0.0186769999563694 0.018718000501394272 0.018757998943328857 0.018759001046419144 0.01879899948835373 0.018921000882983208 0.018921000882983208 0.018921000882983208 0.01896199956536293 0.019001999869942665 0.0192050002515316 0.019245998933911324 0.019286999478936195 0.019287999719381332 0.019328000023961067 0.019328000023961067 0.019367998465895653 0.01936900056898594 0.01948999986052513 0.019531000405550003 0.01953199878334999 0.019572000950574875 0.019572000950574875 0.01973399892449379 0.019734999164938927 0.01977499946951866 0.0197759997099638 0.0197759997099638 0.019816000014543533 0.019857000559568405 0.019857000559568405 0.01989699900150299 0.019937999546527863 0.019979000091552734 0.020262999460101128 0.020263999700546265 0.020305000245571136 0.0206300001591444 0.020670000463724136 0.020792998373508453 0.021036000922322273 0.021118000149726868 0.02115900069475174

Current
Mean: 0.020 ms
Stdev: 0.001 ms (6.7%)
Runs: 0.017780998721718788 0.017903998494148254 0.017904000356793404 0.018066000193357468 0.018107999116182327 0.01814800128340721 0.01814800128340721 0.01822900027036667 0.018352000042796135 0.0186769999563694 0.018838999792933464 0.018838999792933464 0.0188400000333786 0.018880000337958336 0.019003000110387802 0.019043000414967537 0.019245998933911324 0.019245998933911324 0.019368000328540802 0.01941000111401081 0.019449999555945396 0.01973399892449379 0.01977499946951866 0.01977499946951866 0.01989700086414814 0.01993900164961815 0.019977999851107597 0.020222999155521393 0.020223001018166542 0.020223001018166542 0.02034500055015087 0.02034500055015087 0.02034500055015087 0.020385999232530594 0.020506998524069786 0.020507000386714935 0.020508000627160072 0.020508000627160072 0.020508000627160072 0.020547999069094658 0.020549001172184944 0.02058899961411953 0.020628999918699265 0.020792998373508453 0.021118000149726868 0.02120000123977661 0.021361999213695526 0.021362999454140663 0.021402999758720398 0.021443000063300133 0.021484000608325005 0.02185099944472313 0.021932000294327736 0.022053999826312065 0.02213599905371666 0.022664999589323997 0.022704999893903732 0.022746000438928604 0.022746000438928604
App start time (CPU) Baseline
Mean: 146.664 %
Stdev: 3.722 % (2.5%)
Runs: 137.68004903463074 139.24531888603747 139.72055888223568 140.792828685259 140.8223552894212 140.9705638822556 141.0555796615519 141.5993019836891 142.90694663027676 143.493041749503 143.5873273373572 143.7294301056644 143.81237328504227 144.34638786942247 144.4223107569722 144.83033932135734 145.23428390743274 145.34055509462908 145.4880186337596 145.54953837345235 145.58267716535437 145.70858283433137 145.7529880478088 146.08661417322838 146.44865338904705 146.5596186659571 146.65448687725916 146.70658682634738 146.75298804780883 146.95165945165945 147.073442048709 147.14601637678564 147.40550778171217 147.41035856573714 147.54554635748428 147.70459081836336 147.70459081836339 147.75416975683652 148.5 148.5336100706953 148.6454183266933 148.75499478377267 148.88023952095813 148.91518737672587 149 150.03155694055465 150.36394943842217 150.69860279441127 150.69860279441127 150.90331742337585 150.94722070632267 151.48443270938446 151.62573052437094 152.74501992031878 152.87824351297414 153.13374710965076 155.50572162448017

Current
Mean: 146.707 %
Stdev: 6.788 % (4.6%)
Runs: 129.3969252215789 131.73652694610783 135.63908040492726 135.69291338582678 136.8147790862284 136.9406855580179 138.62992125984255 138.66600397614317 139.2169417567824 139.61519192690324 139.7205588822356 139.99214145383107 141.35437212360293 141.5467196819086 141.71656686626756 141.8882235528943 142.08486455007332 142.1980198019802 142.22145077556692 143.1110695324743 143.71257485029955 144.56349206349205 144.93057972231898 145.28571428571428 145.4625540172142 145.5595086793866 145.7252656882591 145.748666497333 146.38027212284638 147.3663366336634 147.87824351297414 148.2491229741099 148.5183387861806 148.72541085657375 148.8444084989064 148.99273396326444 149.26598416071084 149.44937541091392 149.70059880239532 149.81836327345317 150.5276299989663 150.56349206349208 150.58130750451298 151.5156937121773 151.93909626719056 152.15996578272035 152.40795529257076 152.57291782189202 153.19500320909194 153.2857142857143 153.63745019920324 154.29854576561172 154.34807329592473 155.533375918237 155.5994729907774 156.06727995634213 156.12549800796816 156.68662674650707 156.69651985441456 162.33791748526525
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 374.683 MB
Stdev: 2.442 MB (0.7%)
Runs: 367.900390625 368.6015625 370.515625 370.951171875 370.951171875 371.509765625 371.7734375 372.03515625 372.373046875 372.640625 372.822265625 372.849609375 372.8671875 372.900390625 372.970703125 373.13671875 373.212890625 373.333984375 373.55859375 373.765625 373.869140625 373.87890625 374.1796875 374.271484375 374.423828125 374.443359375 374.802734375 374.84375 375.001953125 375.1796875 375.3515625 375.5078125 375.75390625 375.767578125 375.828125 375.87109375 375.955078125 376.05859375 376.07421875 376.13671875 376.2578125 376.2734375 376.412109375 376.787109375 376.830078125 377.03125 377.189453125 377.2109375 377.232421875 377.458984375 377.5 377.748046875 377.8203125 378.291015625 379.015625 379.326171875

Current
Mean: 369.625 MB
Stdev: 7.893 MB (2.1%)
Runs: 352.072265625 354.51953125 356.162109375 357 357.455078125 357.8828125 358.23046875 358.298828125 359.158203125 359.900390625 360.53125 360.669921875 360.771484375 362.068359375 362.16015625 362.66796875 364.328125 364.724609375 364.833984375 365.712890625 365.755859375 366.75 367.25 367.310546875 367.388671875 367.67578125 368.1171875 369.46484375 369.83984375 369.998046875 372.92578125 373.40625 373.4765625 374.30078125 374.703125 375.275390625 375.345703125 375.40625 375.41015625 375.529296875 375.654296875 375.92578125 376.369140625 376.515625 376.642578125 376.947265625 377.064453125 377.126953125 377.251953125 377.369140625 377.69921875 377.775390625 377.890625 378.072265625 378.18359375 378.3203125 378.4140625 378.8828125 379.87890625 381.05078125
App start time (CPU/JS) Baseline
Mean: 80.016 %
Stdev: 1.795 % (2.2%)
Runs: 75.8 76.3 77.3 77.4 77.8 77.9 78.1 78.3 78.4 78.4 78.4 78.5 78.6 78.7 78.7 78.8 78.8 78.9 79 79.2 79.3 79.4 79.4 79.7 79.8 79.8 79.8 79.8 79.9 79.9 80 80 80.2 80.3 80.4 80.4 80.5 80.8 80.8 80.8 80.8 80.9 80.9 81.1 81.1 81.8 81.8 81.8 81.8 82 82.3 82.7 82.8 83.2 83.6 83.8 84.2

Current
Mean: 79.707 %
Stdev: 1.902 % (2.4%)
Runs: 75.6 76 76.3 76.8 76.8 76.8 77.3 77.4 77.7 77.8 77.8 77.9 78.6 78.8 78.8 78.8 78.9 78.9 79.1 79.1 79.2 79.2 79.5 79.5 79.6 79.7 79.8 79.8 79.9 79.9 80 80 80.1 80.1 80.1 80.3 80.5 80.6 80.7 80.7 80.7 80.8 80.9 81 81.2 81.2 81.7 81.7 81.8 81.8 82.2 82.9 83.6 83.8 84.2
App start time (CPU/UI) Baseline
Mean: 27.576 %
Stdev: 1.970 % (7.1%)
Runs: 22.8 23.7 23.9 24 24.9 24.9 25 25.6 25.7 25.7 25.8 25.8 25.9 25.9 25.9 26 26.6 26.9 26.9 26.9 26.9 27 27 27 27 27.2 27.6 27.8 27.9 27.9 27.9 27.9 27.9 27.9 28 28 28 28.1 28.3 28.6 28.6 28.6 28.6 28.7 28.7 28.8 28.9 28.9 28.9 29.6 29.9 29.9 30 30 30.1 30.9 31.5 31.8 31.9

Current
Mean: 27.358 %
Stdev: 1.938 % (7.1%)
Runs: 22.9 23 23.7 24 24 24.8 24.9 24.9 25.8 25.8 25.9 25.9 25.9 25.9 26 26 26.5 26.6 26.7 26.7 26.8 26.8 26.8 26.9 26.9 26.9 27 27 27 27 27.3 27.6 27.6 27.8 27.8 27.8 27.9 27.9 27.9 27.9 27.9 28 28.6 28.9 28.9 28.9 28.9 28.9 28.9 29 29 29.5 29.5 29.8 29.9 29.9 30.1 30.9 31.6 31.9
Open search router TTI Load Search Options Baseline
Mean: 105.455 ms
Stdev: 8.504 ms (8.1%)
Runs: 87.82975200004876 92.65425699949265 94.02368099987507 94.69726499915123 95.17736800014973 95.44665499962866 96.27864599972963 97.02823900058866 97.15958699956536 97.24157699942589 97.53373200073838 97.87923200055957 98.0539549998939 98.2651779986918 98.49047800153494 98.56286599859595 98.95853600092232 99.0012619998306 99.58154300041497 99.80403700098395 99.86348400078714 100.59175600111485 100.60636400058866 100.87162300013006 101.34334299899638 101.85497999936342 101.97082499973476 102.75476099923253 102.9231369998306 103.54211499914527 105.31746399961412 106.9273269996047 107.00512699969113 107.67785700038075 108.19413300044835 108.24767999909818 108.44515000097454 109.60522399842739 110.1669520009309 110.37097200006247 110.9989010002464 111.4003500007093 111.58719899877906 111.60461400076747 112.64400199986994 113.05997700057924 113.39831499941647 113.41320900060236 114.22733500041068 115.09480799920857 115.21207700110972 117.02518700063229 117.62048400007188 118.08622199855745 118.27425099909306 121.43009399995208 123.3887120001018 125.99731500074267

Current
Mean: 99.895 ms
Stdev: 4.244 ms (4.2%)
Runs: 88.4453930016607 88.73299100063741 88.7449140008539 94.19156899861991 94.64563000015914 95.55965199880302 95.75638899952173 96.10851999931037 96.14298499934375 96.26318399980664 96.41101099923253 96.89339200034738 96.91198700107634 97.05896000005305 97.15210000053048 97.19116200134158 97.64327000081539 97.8043210003525 97.97668499872088 98.01981600001454 98.15657499991357 98.3198649995029 98.55175700038671 98.62894700095057 98.94925899989903 99.13924100063741 99.21260599978268 99.4394129998982 99.57206200063229 99.70231200009584 99.91540599986911 100.06591800041497 100.2871499992907 100.30236800014973 101.81701700016856 101.98205600120127 102.01249199919403 102.16507999971509 102.59391300007701 102.60078999958932 102.61116600036621 102.81066900119185 102.90616900101304 102.98897300101817 103.07564300112426 103.13033099845052 103.17659500055015 103.20894400030375 103.31306999921799 103.43310599960387 104.09029100090265 104.28971400111914 104.3429359998554 104.81571500003338 105.24251300096512 106.98535200022161 107.2141930013895 107.34639500081539 107.75345899909735
Open search router TTI (CPU) Baseline
Mean: 131.652 %
Stdev: 4.788 % (3.6%)
Runs: 119.57575757575762 119.86183394234773 120.94293289338643 124.4178310046573 125.30605210974403 125.3088152571707 126.37182694626499 127.00449261296535 128.26935769894476 128.3651562550287 128.47041347127956 128.53380840479568 128.7256427039954 128.86474484112102 128.86856495342644 129.02084277659816 129.10310666809423 129.21358615505105 129.33554054161092 129.67552362727568 129.73917918894676 130.20783829167064 130.2252166045007 130.30197838841423 130.40585495675316 130.42225991483508 130.48170326014642 130.5692295888756 130.89001325033576 131.0117931467742 131.0711909514305 131.33155601148303 131.57025908421727 131.74743209464205 131.8372837658017 132.35071806500378 132.44300781331367 132.60161841769298 132.82910653180062 133.03801507307466 133.10800692927162 133.26546906187622 134.07367085889095 134.27726220865043 134.3978709248171 135.26555624889994 135.54186432559757 135.9695096728073 136.39387890884902 136.49873666368327 137.38222701808562 137.8733445623418 138.31169003294872 138.6917573447973 138.71947980789133 138.95252503607756 139.0217353698099 139.11405343363737 139.1363938789089 142.78873220267116

Current
Mean: 133.129 %
Stdev: 4.173 % (3.1%)
Runs: 124.74094332162673 124.79107935479362 126.77716349796049 126.92229608322725 127.32480212789379 127.75017956135443 127.80439121756491 127.80538922155692 127.82559708629749 127.99576335850405 128.8634478620203 128.9538287303216 129.06162709202772 129.07518296739852 129.45291223932782 129.77689243027885 130.00696421126642 130.91553882676712 130.98956485620764 131.09434000080168 131.26659646460934 131.36815187077156 131.4551639293295 131.60270727687384 131.6642054536346 132.31253736941002 132.35068324888692 132.4816350110194 132.8463073852296 132.88092923567535 133.23775556456812 133.30339321357292 133.4469341861432 133.98101031139308 134.007921406106 134.16286522440157 134.7994579630728 135.15479702430565 135.39561833800704 135.47624642233805 135.65230600522597 135.8463073852296 135.98077839893148 136.07763846150914 136.22530653830586 136.44716566508896 136.5017585444955 136.9302394382865 137.06791869511946 137.35160784722453 137.53418138786554 138.1376805797826 138.1525167448855 138.867281792462 138.8863277050528 139.23224890698637 139.5476409144901 139.66885105675115 140.74078138543638 141.75959539718733
Open search router TTI (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Open search router TTI (RAM) Baseline
Mean: 381.330 MB
Stdev: 2.964 MB (0.8%)
Runs: 374.40234375 374.63671875 375.9817708333333 377.5221354166667 377.6145833333333 377.66796875 377.890625 378.4661458333333 378.8151041666667 379.22265625 379.42578125 379.66015625 379.828125 379.9153645833333 379.9674479166667 380.0130208333333 380.109375 380.20703125 380.2434895833333 380.2942708333333 380.4114583333333 380.91796875 381.1549479166667 381.1848958333333 381.3216145833333 381.3307291666667 381.33203125 381.4036458333333 381.62890625 381.9557291666667 382.0130208333333 382.02734375 382.0533854166667 382.1080729166667 382.1302083333333 382.5244140625 382.5729166666667 382.8997395833333 382.921875 382.92578125 383.1354166666667 383.13671875 383.1875 383.3255208333333 383.34375 383.7044270833333 384.1028645833333 384.2470703125 385.69921875 388.763671875 388.76953125 389.037109375

Current
Mean: 385.562 MB
Stdev: 5.305 MB (1.4%)
Runs: 375.2958984375 375.6787109375 375.69140625 378.154296875 378.654296875 378.6796875 378.875 379.1796875 380.232421875 380.36328125 380.41015625 380.6787109375 380.8583984375 381.0732421875 381.505859375 381.53125 381.6044921875 381.9427083333333 381.9895833333333 382.0205078125 382.0439453125 382.7216796875 382.9423828125 383.0283203125 383.38671875 384.2978515625 384.353515625 384.6259765625 384.724609375 384.7369791666667 385.2060546875 385.845703125 386.2421875 386.3896484375 386.587890625 386.720703125 387.08203125 387.55078125 387.880859375 388.1123046875 388.671875 388.8876953125 389.1787109375 389.54296875 389.75390625 389.93359375 390.4560546875 390.474609375 391.322265625 391.3759765625 391.7197265625 391.9990234375 392.1474609375 392.7412109375 393.130859375 393.8603515625 393.89453125 394.9892578125 395.03125 395.6884765625
Open search router TTI (CPU/JS) Baseline
Mean: 70.477 %
Stdev: 1.877 % (2.7%)
Runs: 66.5 67.5 67.7 67.7 68.1 68.2 68.2 68.4 68.5 68.5 68.5 68.8 68.9 69 69.1 69.1 69.2 69.3 69.4 69.4 69.5 69.5 69.6 69.6 69.6 70 70 70.1 70.2 70.2 70.5 70.5 70.6 70.6 70.7 70.8 70.9 71 71.1 71.1 71.2 71.2 71.3 71.5 71.7 71.8 72.2 72.2 72.4 72.6 72.6 72.7 72.8 73 73.1 73.1 73.4 73.9 74 75.8

Current
Mean: 75.235 %
Stdev: 1.834 % (2.4%)
Runs: 71.2 71.7 71.9 72 72.2 72.4 72.5 72.8 73 73.1 73.5 73.7 73.7 73.8 73.9 73.9 74 74.2 74.2 74.5 74.6 74.7 74.7 74.9 74.9 75 75.1 75.3 75.4 75.4 75.5 75.5 75.6 75.8 75.8 75.8 75.9 76 76.1 76.1 76.2 76.2 76.2 76.3 76.3 76.8 76.9 76.9 76.9 76.9 77 77.4 77.5 77.5 77.6 77.7 77.9 78 78.7 78.9
Open search router TTI (CPU/UI) Baseline
Mean: 25.062 %
Stdev: 1.372 % (5.5%)
Runs: 22.4 22.5 23 23.1 23.2 23.2 23.2 23.2 23.3 23.3 23.8 23.9 23.9 23.9 23.9 24 24 24 24.3 24.4 24.5 24.5 24.5 24.5 24.6 24.6 24.6 24.6 24.7 25.1 25.1 25.2 25.2 25.2 25.2 25.3 25.3 25.3 25.9 25.9 25.9 25.9 26 26.1 26.4 26.5 26.5 26.5 26.6 26.6 26.6 26.6 26.9 27.1 27.1 27.1 27.1 27.3 27.3 27.3

Current
Mean: 23.322 %
Stdev: 1.822 % (7.8%)
Runs: 19.5 19.9 20.3 20.3 20.4 20.4 20.9 21 21 21 21.3 21.4 21.5 21.5 21.9 21.9 22 22.1 22.1 22.5 22.5 22.9 22.9 22.9 23.3 23.3 23.4 23.4 23.8 23.8 23.9 23.9 23.9 23.9 23.9 24 24 24 24.3 24.3 24.3 24.3 24.4 24.4 24.5 24.6 24.6 24.9 24.9 24.9 24.9 25 25.4 25.5 25.5 25.5 25.9 26.4 27 27.2
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 390.782 ms
Stdev: 29.643 ms (7.6%)
Runs: 328.66809099912643 339.68115300126374 341.01228800043464 344.0665689986199 346.78617399930954 350.09171600081027 351.10599800013006 355.2916670013219 355.44132499955595 356.66040099970996 358.0404460001737 360.37345400080085 360.4630130007863 360.9810390006751 361.10221400111914 363.97233099862933 368.56274399906397 369.15995300002396 369.86971000023186 373.9326990004629 376.3544520009309 376.4889330007136 376.66251699998975 381.98348000086844 386.98217800073326 387.5871990006417 389.5524089988321 389.6740729995072 389.7700599990785 392.9523520004004 394.82539900019765 396.46683800034225 399.5846359990537 399.76135200075805 400.30562400072813 402.07605000026524 402.4605310000479 405.03727200068533 405.47302299924195 405.5608719997108 410.4180510006845 411.075276998803 411.10302800126374 411.2667239997536 415.6030679997057 415.6350100003183 417.76924600079656 418.3668620008975 418.61307800002396 419.33988399989903 422.0491540003568 424.2749029994011 427.8451339993626 427.9261879995465 428.0291339997202 431.8373620007187 433.11218299902976 439.153849998489 441.8130299989134 446.8587239999324

Current
Mean: 387.942 ms
Stdev: 29.630 ms (7.6%)
Runs: 333.9463299997151 334.34102400019765 338.84920299984515 339.2552090007812 345.09236599877477 347.41849800013006 348.37410500086844 352.22163899987936 353.71537300013006 355.3304040003568 357.5401210002601 358.85022000037134 359.6399340014905 361.26228899881244 363.887491999194 364.50353999994695 365.5583910010755 365.7744549997151 368.5538739990443 370.29679400101304 370.3723560012877 370.7799069993198 373.30786100029945 376.09346600063145 377.0185949988663 379.23140499927104 385.30777999944985 385.3167730011046 385.98380600102246 386.1140960007906 386.2594809997827 387.5675859991461 392.1676019988954 393.56538899987936 394.8352049998939 401.6004230007529 402.5482990015298 403.45939199998975 404.0168869998306 404.65995300002396 408.46777400001884 409.530802000314 410.99523900076747 411.23779300041497 412.62976000085473 413.1058360002935 413.60095299966633 415.98763000033796 416.921711999923 418.13973000086844 418.2435309998691 420.030680000782 421.14469400048256 425.87784799933434 426.9123129993677 431.49743700027466 431.86828700080514 437.47180199995637 441.99935000017285 446.2274580001831
Report typing (CPU) Baseline
Mean: 98.600 %
Stdev: 5.107 % (5.2%)
Runs: 87.09912142369168 87.39953935406044 88.57780443550534 88.95255416631714 89.1719810362493 89.20316341338813 89.3776978256563 92.16876191930069 92.42268393460806 93.2658373492002 93.266947534677 93.29791927795404 94.1978154989424 94.39264193488245 94.41754881895908 95.16815716639772 96.48502218513646 97.03455471004251 97.10099815449898 97.22786006069292 97.38574818215449 97.64262921025423 98.5653941238076 98.67684496542297 99.01056565675589 99.05718925192659 99.24348126868723 99.38373098539026 99.48291925726966 99.7197830919306 99.96742459937276 99.97580120276834 100.01612691283015 100.02331948308493 100.22846302800806 100.38937910800834 100.43202879520534 100.51270042989633 100.89188364817359 100.91687504788747 100.98895862921854 100.99151773737381 101.5463011932914 102.12064636376908 102.6790055108872 102.83989325303438 103.04603383939983 103.25811167471791 103.29797590492375 103.31439520767825 103.39470883980889 104.32172372236703 104.52605487313318 104.58659651420527 104.85053663173834 105.05991284362459 105.27856511510753 105.50937979394766 106.15848718853039 106.49022218665655

Current
Mean: 98.598 %
Stdev: 5.250 % (5.3%)
Runs: 86.11126174578543 87.02136024937748 87.90714002648112 88.83791032217228 89.26755495601168 89.715859457359 90.11278153342973 90.36360466380198 90.98393903219821 93.57294753851183 94.17915878304576 94.39510460681565 94.52219309728689 94.6173236221684 94.70091796003675 94.85762892221038 95.00572802152776 95.25781869304049 96.19888484354057 96.51104900306964 97.14513143377928 98.1874898864284 98.3491806689287 98.92637313622164 99.35988506788779 99.42285348114257 99.47256718060379 99.70028142561392 99.88616499438275 100.00543768770778 100.02500263731676 100.05834934242398 100.31334298549915 100.53374860740911 100.65774777506012 100.78571539288009 100.80201361841834 100.87190718276898 101.17339370744908 101.18274228147791 101.35205159838033 101.36178448513559 101.51785654555225 102.00381456066147 102.04803853296212 102.67696472064056 103.00850153366876 103.06826435506028 103.41293739081941 103.67426755485538 103.86140224061691 104.1477822411676 104.18499754368992 104.56317431135697 104.82016394616028 105.15173133523278 105.41074479659696 105.59394881936579 106.29875655889866 106.71444249416183
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 507.163 MB
Stdev: 9.485 MB (1.9%)
Runs: 481.30546875 485.263671875 488.02294921875 494.3638392857143 495.88783482142856 495.94308035714283 496.6595982142857 497.6392299107143 497.80887276785717 497.8931361607143 498.18247767857144 498.57861328125 499.16908482142856 499.53431919642856 500.14676339285717 500.75502232142856 501.26674107142856 502.2826450892857 502.49246651785717 502.59849330357144 503.019287109375 503.076171875 503.189453125 503.27978515625 503.50558035714283 503.77734375 504.0287388392857 504.27320772058823 504.663818359375 507.88113839285717 508.98744419642856 509.105712890625 509.3364955357143 509.6549479166667 509.79140625 509.89676339285717 509.90087890625 511.6216517857143 511.89564732142856 512.260498046875 512.5728236607143 513.622802734375 513.8046875 513.87109375 515.5755208333334 515.71875 515.8777901785714 515.9093191964286 516.0912388392857 516.1697916666667 516.9888020833333 517.5198102678571 517.7943638392857 519.0033482142857 519.1277901785714 520.0945870535714 520.4651227678571 520.6638020833333 521.6791294642857 528.3049665178571

Current
Mean: 505.309 MB
Stdev: 7.738 MB (1.5%)
Runs: 486.16517857142856 489.56417410714283 489.86941964285717 494.74637276785717 495.81432291666664 496.47963169642856 496.5717075892857 497.356689453125 497.95786830357144 498.8208705357143 499.04464285714283 499.462890625 499.76339285714283 499.786376953125 500.65708705357144 500.8462611607143 500.86746651785717 501.35435267857144 501.41573660714283 501.47935267857144 501.60379464285717 501.673828125 501.84765625 502.12025669642856 503.0326450892857 503.474609375 503.481201171875 504.185302734375 505.0265625 505.050048828125 505.1997767857143 505.234375 505.873779296875 506.0619419642857 506.204345703125 506.483642578125 506.658447265625 507.7505580357143 507.80419921875 508.306640625 508.6079799107143 509.29541015625 509.6396484375 509.7681361607143 511.3627232142857 511.58203125 511.9467075892857 511.99951171875 512.2837611607143 513.3052455357143 514.0131138392857 514.0446428571429 514.0982142857143 514.4029017857143 517.3337053571429 517.3348214285714 519.04453125 523.3830729166667 524.681640625
Report typing (CPU/JS) Baseline
Mean: 50.803 %
Stdev: 3.740 % (7.4%)
Runs: 42.7 43.4 43.9 44.1 44.2 44.3 44.3 45.2 45.3 47 47 47.8 47.8 47.8 48.3 48.9 48.9 48.9 48.9 49.7 49.8 50.1 50.1 50.2 50.3 50.4 50.7 50.8 50.8 51 51.2 51.5 51.6 51.6 51.7 51.8 52.5 52.8 53 53.1 53.1 53.2 53.3 53.5 53.7 54.1 54.3 54.3 54.3 54.7 54.8 54.8 54.9 55.1 55.2 55.3 56.1 56.3 56.7 57.1

Current
Mean: 50.603 %
Stdev: 3.500 % (6.9%)
Runs: 43.2 43.3 43.3 44.5 44.5 45.6 45.8 46 47 47.4 47.7 48.1 48.4 48.6 48.9 48.9 49 49 49.1 49.4 49.4 49.5 49.5 49.5 49.8 49.9 50.1 50.2 50.3 50.3 50.3 50.5 50.7 50.7 50.7 50.8 50.9 51.1 51.2 51.2 51.6 51.9 53.7 53.7 53.8 53.8 53.8 53.9 54 54.4 54.9 55.1 55.1 55.2 55.3 55.4 55.7 55.8 56.9 57.9
Report typing (CPU/UI) Baseline
Mean: 22.211 %
Stdev: 0.852 % (3.8%)
Runs: 19.8 20.4 20.6 20.7 20.9 21 21.1 21.1 21.2 21.4 21.5 21.5 21.5 21.5 21.5 21.8 21.9 22 22 22 22.1 22.2 22.2 22.2 22.2 22.3 22.3 22.3 22.4 22.4 22.4 22.5 22.5 22.5 22.5 22.6 22.7 22.7 22.7 22.8 22.8 22.8 22.9 22.9 22.9 22.9 22.9 23 23 23.1 23.1 23.1 23.4 23.6 23.7 23.8

Current
Mean: 22.031 %
Stdev: 1.148 % (5.2%)
Runs: 19.4 19.6 19.6 19.8 20.2 20.3 20.3 20.4 20.4 20.7 20.8 20.8 20.9 21.2 21.4 21.4 21.4 21.5 21.5 21.6 21.8 22 22 22 22.2 22.2 22.2 22.3 22.3 22.4 22.4 22.4 22.5 22.5 22.5 22.5 22.6 22.6 22.6 22.6 22.6 22.6 22.6 22.7 22.7 22.8 23 23 23.1 23.2 23.2 23.2 23.3 23.3 23.5 23.5 23.6 24 24.1
Chat opening Chat opening Baseline
Mean: 134.974 ms
Stdev: 9.961 ms (7.4%)
Runs: 118.87223299965262 121.17130599915981 121.90083800069988 123.12451200000942 123.16471400111914 123.62703399918973 123.85917199961841 124.37223299965262 124.43701200000942 124.45731600001454 124.84411599859595 125.03063900023699 125.04333500005305 125.92537399940193 126.85070799849927 126.99975600093603 127.23897300101817 128.78910299949348 129.43591300025582 130.38814300112426 130.45385800115764 130.45817000046372 130.55908199958503 130.6267090011388 131.60477700084448 132.94010400027037 134.11360700055957 134.4585769996047 134.9236240014434 134.9993489999324 135.56591800041497 135.91263800114393 136.5557049997151 136.82291599921882 137.1018470004201 137.1993820015341 137.59305799938738 138.99458800069988 139.51997900009155 140.05851200036705 140.14095100015402 140.562947999686 140.98351999931037 141.20853699930012 143.468302000314 143.60599800013006 144.2860509995371 144.39668800123036 145.11389099992812 145.30920399911702 149.33736100047827 150.19348200038075 150.31640600040555 155.7171219997108 160.9996339995414 162.91121399961412

Current
Mean: 135.192 ms
Stdev: 9.856 ms (7.3%)
Runs: 117.26196300052106 119.7419029995799 123.00976599939167 123.7914230003953 123.84244799986482 124.91629999876022 125.43290199898183 125.5118010006845 125.81754600070417 126.13138899952173 126.97383600100875 127.34379100054502 127.6924229990691 127.87605799920857 128.2362069990486 128.6118170004338 128.8052570000291 128.8417559992522 129.1306149996817 129.62206999957561 129.63647499866784 129.84871499985456 131.2183839995414 131.59415700100362 131.90714499913156 132.45544400066137 132.4863690007478 133.78413899987936 133.94547499902546 134.0384519994259 134.0755199994892 134.52140299975872 134.68229199945927 134.93481500074267 135.0134270004928 135.2088619992137 136.72391800023615 140.87255899980664 141.0761309992522 141.424886001274 141.702677000314 141.80037499964237 141.94742799922824 142.4064530003816 142.48193399980664 143.34745199978352 143.3544520009309 143.91422600112855 145.50305199995637 146.44437599927187 146.46818100102246 149.03776100091636 150.73730499856174 157.35864300094545 160.92622900009155 165.3061120007187
Chat opening Chat TTI Baseline
Mean: 395.344 ms
Stdev: 22.522 ms (5.7%)
Runs: 352.46484399959445 361.94063299894333 363.3519700001925 366.46984900161624 368.3771559987217 369.6058759987354 370.10628200136125 370.3574620001018 370.72432499937713 372.07942699827254 373.0074870008975 373.7955729998648 374.0776370000094 374.10436999984086 375.14835700020194 375.3443600013852 376.45219000056386 377.38696300052106 378.5677900016308 382.7731929998845 383.55069999955595 389.11873399838805 389.2382000014186 390.05452500097454 392.8846030011773 393.07800299860537 393.9679769985378 395.6993820015341 396.96122300066054 398.37137899920344 398.79878699965775 399.3577880002558 401.81538899987936 401.828409999609 402.62878400087357 402.79207300022244 403.17256699874997 404.32364900037646 404.35201100073755 404.66451100073755 405.95601399987936 406.31050699949265 407.1739090010524 407.9057209994644 408.70967699959874 411.71704100072384 413.2113450001925 424.4472650010139 425.4858800005168 426.6684969998896 431.1841640006751 434.44120300002396 435.7245279997587 437.89538599923253 441.5547690000385 448.0722250007093

Current
Mean: 394.472 ms
Stdev: 23.866 ms (6.1%)
Runs: 353.44799800030887 359.5547289997339 359.7398269996047 362.77343800105155 362.8941239994019 363.03593000024557 367.28621400147676 367.4600419998169 368.7906909994781 368.85380000062287 368.93147799931467 369.2266030013561 369.2954099997878 370.32246899977326 370.3438319992274 373.10538799874485 373.70690900087357 374.43957499973476 377.03133200109005 380.9757899995893 382.55647799931467 382.80928600020707 384.0652679987252 386.2898359987885 389.5487879998982 391.3383799996227 391.6348470002413 392.76338700018823 393.8115640003234 395.23079499974847 396.0012619998306 396.1582039985806 398.5706789996475 399.0844729989767 399.42447900027037 400.1013590004295 400.2362470012158 400.3916420005262 401.0516360010952 401.52783199958503 404.52762800082564 408.313069999218 408.672038000077 410.87133800052106 412.1242270004004 417.26208500005305 418.62052400037646 419.2551270015538 419.63651599921286 419.7604580000043 421.3201499991119 422.26664300076663 422.92606600001454 427.0643310006708 428.60103400051594 431.53324399888515 438.8824870008975 440.07702599838376 458.3361000008881
Chat opening (CPU) Baseline
Mean: 134.507 %
Stdev: 6.809 % (5.1%)
Runs: 118.60007020080573 120.80986993106072 121.4400141810759 123.50154056829854 123.50493758930412 125.44749826467321 126.15462071038306 126.35678186771626 127.25583442016304 127.29323608350818 128.13572822544498 128.46464309097607 128.9849833803503 129.1829673985363 129.41191971103095 129.60590972798673 129.9467731204258 130.07024519549375 130.140504844927 130.98452075638065 131.37165192157926 131.8501748152221 131.89919426344375 132.9216980221136 133.5389446965184 133.62832567796139 133.79738312604044 133.99006443281596 134.22562870794053 134.49049509540592 134.64826893543108 135.4209003405311 135.685884691849 136.26798388303558 136.34428161569514 136.39387890884902 136.4790042957696 136.8252480274978 136.9691037581285 137.06783439952068 137.45098039215688 137.72455089820372 138.29816557361465 139.16500994035795 140.27888446215135 140.63167775842876 140.70757636383823 140.8157674028515 141.78576180971393 141.93309633199087 142.18900488752098 142.67923558822946 143.21365487623825 143.68178588252192 143.75017296085113 144.1632796902392 144.30354976321868 145.12441783100473 145.60778705057072 147.77995898172168

Current
Mean: 132.981 %
Stdev: 5.120 % (3.8%)
Runs: 122.7314079324344 123.75249500998001 124.18341259055116 124.22283483537187 124.5708231554651 125.08316699933464 125.1576846307385 126.66277137931077 126.97572498945831 127.33333333333339 127.42755420029211 129.07518296739852 129.36474652286708 129.51541677034461 129.6008226233626 130.02693877442172 130.4058549567532 130.48170326014642 130.8321867591678 131.2411480669025 131.25881570192948 131.31321723565986 131.3756317126072 131.4295363555165 131.8725099601593 131.9078212031868 131.98935607357376 132.23025651811028 132.40186294078515 133.18829008649368 133.27941599883775 133.55459641482912 134.23019165057698 134.54801715953377 134.5587825204224 134.72908535870363 135.09237173488955 135.2672051530776 135.72854291417167 135.84221933169275 136.07166243463314 136.22902108308236 136.393878908849 136.55740075999626 136.8693643341531 136.90407046555578 137.0308740193717 137.0967382080264 137.50274663717005 138.03577854575445 138.38886370684918 140.51031752089335 140.70403983996812 141.3405425915386 141.3836978131214 142.26560424966792 142.38291595761723 142.8001974870564
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 378.716 MB
Stdev: 9.678 MB (2.6%)
Runs: 367.6341145833333 367.6653645833333 367.8372395833333 368.390625 368.8098958333333 368.8359375 368.9192708333333 369.5169270833333 369.5494791666667 369.62109375 369.6653645833333 369.6848958333333 371.0638020833333 371.2005208333333 371.9166666666667 372.6223958333333 372.7552083333333 372.8216145833333 373.2643229166667 373.2747395833333 373.421875 374.5677083333333 374.671875 374.7161458333333 375.4192708333333 375.4674479166667 375.8333333333333 375.99609375 376.08984375 376.1197916666667 376.6380208333333 377.87890625 378.0299479166667 378.08984375 378.1848958333333 378.35546875 378.4192708333333 378.8658854166667 379.1796875 379.234375 379.72265625 380.171875 380.8125 381.6184895833333 383.6197916666667 383.8307291666667 387.48046875 389.3776041666667 391.203125 391.7200520833333 392.7057291666667 398.109375 399.546875 400.2669270833333 401.0807291666667 402.4674479166667 402.8684895833333

Current
Mean: 371.077 MB
Stdev: 5.945 MB (1.6%)
Runs: 360.12890625 361.30078125 361.9192708333333 362.0052083333333 362.1943359375 363.4934895833333 364.65234375 364.8984375 365.578125 366.1158854166667 366.9895833333333 367.2721354166667 367.35546875 367.69921875 367.9375 368.1276041666667 368.265625 368.3932291666667 368.7265625 368.74609375 369.1276041666667 369.1484375 369.30078125 369.6966145833333 369.8216145833333 370.015625 370.18359375 370.2630208333333 370.2825520833333 370.2994791666667 370.6901041666667 370.921875 371 371.5 371.5299479166667 371.7864583333333 371.921875 372.7486979166667 373.2330729166667 374.7213541666667 374.875 375.4934895833333 375.7708333333333 376.6263020833333 376.7005208333333 376.7747395833333 377.3684895833333 377.70703125 378.34375 379.140625 383.8255208333333 383.9739583333333 385.0807291666667 386.4908854166667
Chat opening (CPU/JS) Baseline
Mean: 72.017 %
Stdev: 2.331 % (3.2%)
Runs: 66.8 67 67.2 68.5 68.9 69.1 69.2 69.3 69.4 69.6 70.1 70.2 70.3 70.3 70.3 70.3 70.4 70.5 70.6 70.8 70.8 70.9 71 71.1 71.1 71.5 71.5 71.8 72 72.1 72.2 72.4 72.5 72.6 72.7 72.7 73 73.1 73.1 73.1 73.2 73.3 73.4 73.5 73.6 73.8 73.9 74.1 74.2 74.4 74.5 74.5 74.6 74.7 74.9 74.9 75.1 76.6 76.6 77.2

Current
Mean: 72.125 %
Stdev: 2.617 % (3.6%)
Runs: 66 66.3 67.2 67.9 67.9 67.9 68.6 69.2 69.3 69.4 69.7 70 70.4 70.5 70.6 70.7 70.7 70.8 70.9 70.9 71.1 71.1 71.2 71.2 71.3 71.4 71.6 71.6 71.6 71.7 71.8 72.3 72.3 72.6 73 73.2 73.2 73.3 73.4 73.7 73.7 73.8 74 74 74.1 74.3 74.3 74.4 74.6 74.9 75.1 75.2 75.2 75.4 75.6 75.8 75.8 75.8 77 77
Chat opening (CPU/UI) Baseline
Mean: 24.885 %
Stdev: 1.513 % (6.1%)
Runs: 22.2 22.4 22.5 22.6 22.6 23.1 23.2 23.2 23.2 23.2 23.2 23.3 23.3 23.4 23.7 23.8 23.8 23.9 23.9 24 24 24.4 24.5 24.5 24.6 24.6 24.6 24.6 24.6 24.7 24.8 25 25.1 25.2 25.2 25.2 25.3 25.3 25.3 25.3 25.7 25.8 25.9 25.9 26 26 26 26.4 26.6 26.6 26.7 27.1 27.1 27.1 27.2 27.2 27.3 27.8 28.5

Current
Mean: 24.703 %
Stdev: 1.433 % (5.8%)
Runs: 22.4 22.5 22.5 22.6 22.6 22.7 23 23.1 23.3 23.3 23.3 23.3 23.3 23.3 23.7 23.8 23.9 23.9 23.9 23.9 24 24 24 24 24 24.5 24.5 24.5 24.6 24.6 24.6 24.6 24.6 24.6 24.7 25.2 25.2 25.3 25.3 25.3 25.4 25.7 25.8 25.9 25.9 25.9 25.9 26 26 26.4 26.6 26.6 27.2 27.2 27.2 27.2 27.7 27.8
Linking (CPU) Baseline
Mean: 143.927 %
Stdev: 2.738 % (1.9%)
Runs: 136.61621357295684 138.18493979835998 138.78190439287067 139.40769772399526 139.44310918711702 139.75228879187054 140.14791257953001 140.71883256098315 141.14136919630081 141.33611331454048 141.37259124642875 141.67721002526233 142.05588766793136 142.15889378872373 142.24336304277122 142.2856619588373 142.35857515270948 142.42312533306028 142.5831470004732 142.87930342392454 142.95477574103217 143.07926745398925 143.11452472793496 143.31033796305772 143.36665734778103 143.4330347273581 143.67958653173187 143.78034519196908 143.9211131180452 144.2569404869342 144.4232312227761 144.46786945783876 144.58142837830317 144.60877182285634 144.73331620948463 144.77974675751446 144.9987259909333 145.08284515910202 145.16070052299855 145.17901129811318 145.1885523316563 145.26372587620804 145.51991022729052 145.80567059680257 145.80810309930467 146.61808530904023 146.62504991777385 146.7464567520346 146.7804446027212 146.95553843316543 146.9583407224974 147.20356237766467 147.25324213745736 147.58419505180757 147.60847623667482 147.74203815219175 147.85307491852137 148.4558373501215 149.22019704108988

Current
Mean: 144.827 %
Stdev: 4.209 % (2.9%)
Runs: 136.44594694583492 136.75835296935205 137.9690549598387 138.0693978427765 138.14473161033803 138.96270142442833 139.25413695014467 139.66160863566108 140.01505379854666 140.66044784939618 141.24371947807592 141.35409181636734 141.51425627573278 141.82091012017764 141.87502320792464 141.95853109905192 142.10629962972334 142.32822028691533 142.41711844479704 143.05452834541526 143.22206081915354 143.29613872723664 143.4109681037825 143.4131736526947 143.43223694279692 143.5882036312317 143.89045108398219 144.14093458856235 144.17240490560602 144.26072328227264 144.60285797497238 144.98853959582087 145.08902195608783 145.13819739078195 145.30261082762416 145.44111776447113 145.95679810873693 146.1240104721376 146.2046727518234 146.3141044643386 147.27064919484215 147.279131924243 147.33790472484387 147.44402908626049 147.44492189190768 147.61924900032415 147.72700922266148 147.8987746430479 148.28434417698443 148.8687300034725 148.92665421918565 150.03685589555397 150.5910538739523 151.05480519613502 151.0599858042933 151.17453767164474 152.12621351025638 152.52010414504807 153.0793310236886 154.27917396228062
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 422.079 MB
Stdev: 5.932 MB (1.4%)
Runs: 411.98125 412.55546875 413.17578125 413.8171875 414.16796875 414.26015625 414.565625 415.27890625 415.4359375 415.6109375 415.696875 416.37578125 416.565625 417.11484375 417.4671875 417.496875 418.1484375 418.71953125 418.72421875 418.73203125 418.9578125 419.65546875 419.703125 420.80390625 420.9421875 421.0546875 421.32265625 421.86328125 422.0453125 422.08828125 422.16328125 422.5984375 422.72890625 422.8109375 423.02890625 423.19765625 423.26953125 423.60625 423.6296875 423.75625 424.3546875 425.54921875 425.8609375 426.09375 426.215625 426.596875 426.86171875 427.06484375 428.778125 429.53203125 429.78359375 429.8046875 430.515625 430.975 431.81328125 432.61171875 434.8625 438.1640625

Current
Mean: 424.644 MB
Stdev: 7.679 MB (1.8%)
Runs: 408.8671875 411.83125 412.86875 413.4296875 414.7921875 414.86640625 415.38828125 416.69921875 417.06796875 417.471875 417.60625 418.0015625 418.04921875 419.31875 419.56484375 419.865625 420.0375 420.3171875 420.37265625 420.48984375 421.1796875 421.30703125 421.4578125 421.4640625 422.21171875 422.28125 422.51015625 422.78203125 423.2515625 423.253125 423.26328125 423.2875 423.296875 424.1734375 425.05234375 425.69296875 426.06875 426.4515625 427.278125 428.32421875 428.4765625 429.025 429.6890625 430.41015625 430.63046875 431.3203125 431.34453125 432.1921875 432.2984375 432.4921875 433.3703125 433.6703125 435.2265625 435.54921875 435.5578125 436.671875 436.7272135416667 440.31640625 447.5123697916667
Linking (CPU/JS) Baseline
Mean: 80.007 %
Stdev: 1.452 % (1.8%)
Runs: 76.1 76.4 77.9 78 78.1 78.2 78.3 78.6 78.6 78.8 78.8 78.8 78.9 79 79.1 79.1 79.2 79.2 79.2 79.3 79.5 79.5 79.5 79.6 79.6 79.7 79.7 79.7 79.8 79.9 79.9 79.9 80.1 80.2 80.2 80.3 80.3 80.5 80.6 80.6 80.7 81 81 81.1 81.1 81.2 81.3 81.3 81.3 81.5 81.5 81.6 81.9 82.2 82.3 82.5 82.6 82.6 83

Current
Mean: 80.859 %
Stdev: 1.617 % (2.0%)
Runs: 77.1 77.6 77.6 77.8 78.3 78.5 78.6 78.6 78.9 79.1 79.1 79.8 79.9 79.9 80.1 80.1 80.1 80.2 80.3 80.3 80.3 80.4 80.4 80.5 80.6 80.6 80.7 80.9 81.1 81.2 81.2 81.2 81.3 81.3 81.3 81.4 81.6 81.6 81.7 81.7 81.9 81.9 81.9 82 82.1 82.2 82.2 82.2 82.4 82.5 82.7 82.7 82.7 82.7 82.9 83.5 83.7 84.7
Linking (CPU/UI) Baseline
Mean: 24.995 %
Stdev: 0.962 % (3.8%)
Runs: 23.1 23.1 23.4 23.5 23.8 23.8 23.9 23.9 24 24.3 24.3 24.3 24.3 24.3 24.3 24.3 24.3 24.6 24.6 24.7 24.7 24.7 24.7 24.7 24.7 24.7 24.7 24.7 24.7 24.8 25 25 25 25 25.1 25.1 25.1 25.2 25.2 25.4 25.5 25.5 25.5 25.5 25.6 25.6 25.8 25.9 25.9 25.9 25.9 25.9 25.9 26 26.3 26.6 27.2 27.6 27.6

Current
Mean: 25.363 %
Stdev: 1.428 % (5.6%)
Runs: 22.3 22.4 22.7 23.2 23.5 23.5 23.7 23.8 23.9 24.2 24.3 24.3 24.3 24.3 24.3 24.4 24.6 24.7 24.7 24.7 24.8 24.8 24.8 25 25.1 25.1 25.1 25.1 25.1 25.1 25.2 25.2 25.4 25.4 25.4 25.5 25.6 25.6 25.8 25.9 25.9 25.9 26 26 26 26.2 26.3 26.4 26.6 26.7 26.7 26.8 27.3 27.4 27.5 28 28.1 28.4 28.4 28.4
Linking Baseline
Mean: 214.762 ms
Stdev: 33.045 ms (15.4%)
Runs: 171.6437979992479 173.14322899840772 173.21439599990845 175.98014399968088 176.77054900117218 176.92883300036192 177.21411199867725 177.57015000097454 178.15429699979722 179.45389799959958 180.43310599960387 181.91247499920428 183.98404899984598 184.27132200077176 184.93245399929583 187.04398600012064 187.1785070002079 187.34570300020278 187.56376099959016 188.29581699892879 189.74922700040042 190.45715299993753 191.9917399995029 193.83337499946356 194.3354080002755 197.4520269986242 197.87369799986482 198.06290700100362 198.09969099983573 200.02746599912643 201.32263199985027 203.25952099822462 203.74060099944472 208.79219599999487 233.41158099845052 235.12968000024557 237.71406999975443 239.0545249991119 242.1639809999615 243.06713899970055 245.5228679999709 247.21789599955082 247.36332199908793 248.60030100122094 248.86665900051594 250.5754799991846 251.56603999994695 252.4759929999709 253.99760000035167 256.17769400030375 256.5237630009651 257.409098001197 258.33504200167954 258.8628749996424 260.06070999987423 262.69425499998033 265.1337480004877 267.3183999992907 269.68538400158286

Current
Mean: 218.243 ms
Stdev: 39.825 ms (18.2%)
Runs: 165.73559600114822 168.99788399972022 169.79858399927616 171.91829499974847 173.6736660003662 174.73620599880815 179.14168300107121 179.56180799938738 180.56636600010097 180.9612229987979 182.56905199959874 183.83357799984515 183.94746899977326 184.0720620006323 184.69763199985027 185.219197999686 187.13578299991786 187.7303069997579 187.7602540012449 188.7215580008924 188.9761960003525 189.94584099948406 190.20792699977756 190.51566600054502 190.54610200040042 194.90991199947894 195.26814799942076 195.28666200116277 197.9508459996432 200.21325699985027 203.359375 213.3195799998939 219.03470800071955 219.8419189993292 220.18119299970567 220.31652799993753 226.33085099980235 228.4770919997245 235.60115600004792 237.6971030011773 239.33878600038588 240.6019289996475 241.36861199885607 242.1426190007478 254.9711100012064 254.9743239991367 255.0813810005784 259.41052299924195 264.1072999984026 264.50834099948406 265.59639499895275 265.7844229992479 266.5664470009506 273.09248900040984 276.54186999984086 276.5426439996809 277.2292080000043 280.26216599904 292.62015799991786 345.07543999888003

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

Copy link
Contributor

🚀 Deployed to production by https://github.com/Beamanator in version: 9.0.55-10 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 failure ❌
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 skipped 🚫
🍎🔄 iOS HybridApp 🍎🔄 skipped 🚫

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DeployBlockerCash This issue or pull request should block deployment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants