Skip to content

Reliability reports by platforms #884

Description

@legendecas
          The reliability reports are generated by dates and can not be filtered to list what's failing on a specific platform. Would it be helpful to generate a reliability summary filtered by platforms? It can help us to find out the reliability of each platform.

Originally posted by @legendecas in nodejs/node#56583 (comment)

A possible improvement is to generate JSON reliability reports so that the reports can be processed programatically and be filtered by platforms.

A reliability history by platform can provide supporting figures for us to determine if a platform is unstable.

Activity

  1. 0hmX commented on Aug 11, 2025

    @0hmX

    Hey @legendecas, I would love to help with this one. Three of my PRs are stuck due to a bad CI, and it's annoying to ask the maintainer every time for a CI run. If solving this issue helps, I am ready to. I have set up the repository and run the tests; all are passing. I need to know which command I need to look at.

  2. legendecas commented on Aug 11, 2025

    @legendecas
    MemberAuthor

    The report workflow is defined at https://github.com/nodejs/reliability/blob/81db301596de4717b67c8463d841665f4d8ee053/.github/workflows/reliability_report.yml#L43-L48.

    The command is defined at

    async aggregate() {
    const { argv, cli } = this;
    if (this.queue.length === 0) {
    return;
    }
    const aggregator = new FailureAggregator(cli, this.json);
    this.json = aggregator.aggregate();
    cli.log('');
    cli.separator('Stats');
    cli.log('');
    aggregator.display();
    if (argv.markdown || argv.copy) {
    this.markdown = aggregator.formatAsMarkdown();
    }
    }
    .

    There is a --json option available, along with --markdown (link). It can be updating the workflow in the nodejs/reliability to pick up the option --json, as it seems already been supported at

    this.json = aggregator.aggregate();
    .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestNew features for node-core-utils

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions