investigate flaky test-performance-eventlooputil #35309

Activity

1. Trott

   added

   flaky-testIssues and PRs involving tests that fail intermittently in CI.Issues and PRs involving tests that fail intermittently in CI.

   on Sep 23, 2020
2. Trott commented on Oct 7, 2020

   

   Trott

   on Oct 7, 2020

   MemberAuthor

   More actions

   • Platform: ubuntu1804_sharedlibs_debug_x64
   • Console Output:

   00:14:39 not ok 1623 parallel/test-performance-eventlooputil
   00:14:39   ---
   00:14:39   duration_ms: 0.270
   00:14:39   severity: fail
   00:14:39   exitcode: 1
   00:14:39   stack: |-
   00:14:39     assert.js:386
   00:14:39         throw err;
   00:14:39         ^
   00:14:39     
   00:14:39     AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
   00:14:39     
   00:14:39       assert.ok(elu2.active > elu3.active)
   00:14:39     
   00:14:39         at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-eventlooputil.js:41:10)
   00:14:39         at listOnTimeout (internal/timers.js:555:17)
   00:14:39         at processTimers (internal/timers.js:498:7) {
   00:14:39       generatedMessage: true,
   00:14:39       code: 'ERR_ASSERTION',
   00:14:39       actual: false,
   00:14:39       expected: true,
   00:14:39       operator: '=='
   00:14:39     }
   00:14:39   ...
   

   • Build Links: https://ci.nodejs.org/job/node-test-commit-linux-containered/nodes=ubuntu1804_sharedlibs_debug_x64/22684/console
3. Trott commented on Oct 7, 2020

   

   Trott

   on Oct 7, 2020

   Last edited by Trott

   MemberAuthor

   More actions

   The test seems inherently flaky, likely on all or nearly all platforms. I don't even need to run it concurrently locally to get it to fail. Here's a stress test to see if we can get a handle on how often it fails. https://ci.nodejs.org/job/node-stress-single-test/185/

   (EDIT: 1 failure in 856 runs so far on debian9-64. Might be interesting to see if it fails more or less often on slow machines vs. fast machines and if common.platformTimeout() helps. Also might be interesting to experiment with parallel test jobs to see if it is affected by being in parallel or not.)
4. Flarna commented on Nov 1, 2020

   

   Flarna

   on Nov 1, 2020

   Member

   More actions

   One more which has some more info in assert:

   AssertionError [ERR_ASSERTION]: 50.29698935913086 <= 50.68267250061035
       at Timeout.r (/home/iojs/build/workspace/node-test-commit-linux/nodes/ubuntu1604-64/test/parallel/test-performance-eventlooputil.js:46:10)
       at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux/nodes/ubuntu1604-64/test/common/index.js:377:15)
       at listOnTimeout (node:internal/timers:555:17)
       at processTimers (node:internal/timers:498:7) {
     generatedMessage: false,
     code: 'ERR_ASSERTION',
     actual: false,
     expected: true,
     operator: '=='
   }
   

   https://ci.nodejs.org/job/node-test-commit-linux/37969/nodes=ubuntu1604-64/testReport/junit/(root)/test/parallel_test_performance_eventlooputil/
5. Trott

   added a commit that references this issue on Nov 10, 2020

   test: fix races in test-performance-eventlooputil

   ...

   135dd88
6. Trott

   closed this as completedin 135dd88on Nov 10, 2020
7. danielleadams

   added a commit that references this issue on Nov 10, 2020

   test: fix races in test-performance-eventlooputil

   ...

   fdae9ad
8. richardlau

   added a commit that references this issue on Mar 29, 2021

   test: fix races in test-performance-eventlooputil

   ...

   364bf03
9. targos

   added a commit that references this issue on May 1, 2021

   test: fix races in test-performance-eventlooputil

   ...

   2383501