Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: fix flaky test-benchmark-es #17516

Closed
wants to merge 1 commit into from
Closed

Conversation

Trott
Copy link
Member

@Trott Trott commented Dec 7, 2017

Allow zero iterations for short benchmark in test.

Checklist
  • make -j4 test (UNIX), or vcbuild test (Windows) passes
  • commit message follows commit guidelines
Affected core subsystem(s)

test benchmark

Allow zero iterations for short benchmark in test.
@Trott Trott added benchmark Issues and PRs related to the benchmark subsystem. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test Issues and PRs related to the tests. labels Dec 7, 2017
@Trott
Copy link
Member Author

Trott commented Dec 7, 2017

Sample failure in CI:

https://ci.nodejs.org/job/node-test-commit-linux/14741/nodes=alpine35-container-x64/consoleFull

not ok 148 parallel/test-benchmark-es
  ---
  duration_ms: 3.27
  severity: fail
  stack: |-
    
    es/defaultparams-bench.js
    es/defaultparams-bench.js millions=0.000001 method="": 0.00597760788087823
    
    es/destructuring-bench.js
    es/destructuring-bench.js millions=0.000001 method="": 0.007550075878262576
    
    es/destructuring-object-bench.js
    /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:202
          throw new Error('insufficient clock precision for short benchmark');
          ^
    
    Error: insufficient clock precision for short benchmark
        at Benchmark.end (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:202:13)
        at runNormal (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/es/destructuring-object-bench.js:21:9)
        at main (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/es/destructuring-object-bench.js:43:7)
        at Benchmark.process.nextTick (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/benchmark/common.js:34:28)
        at process._tickCallback (internal/process/next_tick.js:150:11)
        at Function.Module.runMain (module.js:703:11)
        at startup (bootstrap_node.js:195:16)
        at bootstrap_node.js:646:3
    assert.js:42
      throw new errors.AssertionError({
      ^
    
    AssertionError [ERR_ASSERTION]: 1 strictEqual 0
        at ChildProcess.child.on (/home/iojs/build/workspace/node-test-commit-linux/nodes/alpine35-container-x64/test/common/benchmark.js:25:12)
        at ChildProcess.emit (events.js:126:13)
        at Process.ChildProcess._handle.onexit (internal/child_process.js:209:12)
  ...

@Trott
Copy link
Member Author

Trott commented Dec 7, 2017

CI: https://ci.nodejs.org/job/node-test-pull-request/11934/

[UPDATE: It's green.]

Trott added a commit to Trott/io.js that referenced this pull request Dec 9, 2017
Allow zero iterations for short benchmark in test.

PR-URL: nodejs#17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@Trott
Copy link
Member Author

Trott commented Dec 9, 2017

Landed in f01e9e7

@Trott Trott closed this Dec 9, 2017
MylesBorins pushed a commit that referenced this pull request Dec 12, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
MylesBorins pushed a commit that referenced this pull request Dec 12, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@MylesBorins MylesBorins mentioned this pull request Dec 12, 2017
gibfahn pushed a commit that referenced this pull request Dec 20, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@gibfahn gibfahn mentioned this pull request Dec 20, 2017
gibfahn pushed a commit that referenced this pull request Dec 20, 2017
Allow zero iterations for short benchmark in test.

PR-URL: #17516
Reviewed-By: Anatoli Papirovski <apapirovski@mac.com>
Reviewed-By: Colin Ihrig <cjihrig@gmail.com>
@gibfahn gibfahn mentioned this pull request Dec 20, 2017
@Trott Trott deleted the fix-es-bench-test branch January 13, 2022 22:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmark Issues and PRs related to the benchmark subsystem. flaky-test Issues and PRs related to the tests with unstable failures on the CI. test Issues and PRs related to the tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants