Skip to content

Randomize execution order to prevent side effects (from other runs or Github CI itself) affecting too much results #444

Open
@Elanis

Description

@Elanis

We should create a list of 15 runs of each framework and profile (Release/Debug), shuffle this list and run in this order.
E.g, possible run order:

  • electron release
  • tauri debug
  • nw.js release
  • electron debug
  • wails debug
  • tauri debug
  • electron release
  • nw.js debug
  • and so on

This will prevent results being affected by memory being re-used, webview being re-used, or CI environment affecting results in a good/bad way for only one framework.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions