Skip to content

CI Reliability 2022-09-26 #385

New issue
New issue
Open
Open
CI Reliability 2022-09-26#385
@github-actions

Description

@github-actions
github-actions
opened on Sep 26, 2022

Failures in node-test-pull-request/46696 to node-test-pull-request/46788 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-09-26 00:18 6 9 9 4 72 10.00%

JSTest Failure

Reason sequential/test-cpu-prof-drained
Type JS_TEST_FAILURE
Failed PR 5 (nodejs/node#44774, nodejs/node#44763, nodejs/node#44675, nodejs/node#44779, nodejs/node#44778)
Appeared test-equinix-ubuntu1804_sharedlibs_container-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46752/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46757/
Example 
not ok 3685 sequential/test-cpu-prof-drained
  ---
  duration_ms: 0.516
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":3,"result":{}}
    
    
    #
    # Fatal error in ../deps/v8/src/execution/frames.h, line 190
    # Debug check failed: static_cast<uintptr_t>(type) < Type::NUMBER_OF_TYPES (93825331403216 vs. 24).
    #
    #
    #
    #FailureMessage Object: 0xffffe926d968
     1: 0xaaaab28d093c node::DumpBacktrace(_IO_FILE*) [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     2: 0xaaaab2aae880  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     3: 0xaaaab2aae8b4  [/home/iojs...
Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44675, nodejs/node#44696, nodejs/node#44778)
Appeared test-rackspace-win2012r2_vs2017-x64-3, test-rackspace-win2012r2_vs2013-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46755/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46781/
Example 
not ok 806 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 1.252
  severity: fail
  exitcode: 134
  stack: |-
    FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
  ...
Reason sequential/test-cpu-prof-dir-relative
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44758, nodejs/node#44412, nodejs/node#44754)
Appeared test-equinix-ubuntu1804_sharedlibs_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46730/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46732/
Example 
not ok 3683 sequential/test-cpu-prof-dir-relative
  ---
  duration_ms: 0.335
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":3,"result":{}}
    
    
    #
    # Fatal error in ../deps/v8/src/execution/frames.h, line 190
    # Debug check failed: static_cast<uintptr_t>(type) < Type::NUMBER_OF_TYPES (140737487869144 vs. 24).
    #
    #
    #
    #FailureMessage Object: 0xfffffff109d8
     1: 0xaaaac7cdc93c node::DumpBacktrace(_IO_FILE*) [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     2: 0xaaaac7eba880  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]
     3: 0xaaaac7eba8b4  [/hom...
Reason sequential/test-watch-mode-inspect
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#44754, nodejs/node#44758, nodejs/node#44436)
Appeared test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46732/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46735/
Example 
not ok 3786 sequential/test-watch-mode-inspect
  ---
  duration_ms: 120.163
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    (node:41648) ExperimentalWarning: The test runner is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
  ...
Reason parallel/test-crypto-key-objects
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs-private/node-private/pull/342/, https://github.com/nodejs-private/node-private/pull/352/)
Appeared test-nearform-macos10.15-x64-1, test-joyent-smartos20-x64-3, test-joyent-smartos20-x64-4, test-orka-macos10.14-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46704/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46721/
Example 
not ok 383 parallel/test-crypto-key-objects
  ---
  duration_ms: 0.402
  severity: crashed
  exitcode: -6
  stack: |-
  ...
Reason parallel/test-http2-misbehaving-multiplex
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#44741, nodejs/node#44696)
Appeared test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/46771/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46772/
Example 
not ok 1662 parallel/test-http2-misbehaving-multiplex
  ---
  duration_ms: 0.214
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: 5
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http2-misbehaving-multiplex.js:45:10)
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/common/index.js:446:15)
        at Http2Server.emit (node:events:513:28)
        at ServerHttp2Session.sessionOnStream (node:internal/http2/core:2999:19)
        at ServerHttp2Session.emit (node:events:513:28)
        at emit (node:internal/http2/core:329:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:85:22) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 5,
      expected: 5,
      operator: 'notStrictEq...
Reason sequential/test-perf-hooks
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#44779, nodejs/node#44782)
Appeared test-digitalocean-fedora32-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/46756/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46766/
Example 
not ok 3779 sequential/test-perf-hooks
  ---
  duration_ms: 1.613
  severity: fail
  exitcode: 1
  stack: |-
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 37.9613037109375 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 37.921607971191406, delay: 2500 },
      environment: { around: 0 },
      loopStart: -1,
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1044.084243774414 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 37.921607971191406, delay: 2500 },
      environment: { around: 0 },
      loopStart: { around: 37.921607971191406, delay: 2500 },
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1437.6282119750977 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around:...

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs-private/node-private/pull/342/, nodejs/node#44758, nodejs/node#44779)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2, test-orka-macos10.14-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46702/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46756/
Example 
java.io.IOException: Backing channel 'JNLP4-connect connection from 45.55.90.237/45.55.90.237:35276' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy92.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs-private/node-private/pull/350/, nodejs/node#44763)
Appeared test-softlayer-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46720/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46779/
Example 
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure

Reason ERROR: Error fetching remote repo 'jenkins_tmp'
Type GIT_FAILURE
Failed PR 10 (nodejs/node#44690, nodejs/node#44739, nodejs/node#44758, nodejs/node#44741, nodejs/node#44779, nodejs/node#44693, nodejs/node#44683, nodejs/node#44689, nodejs/node#44778, nodejs/node#44763)
Appeared test-softlayer-rhel8_arm_cross_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46737/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46784/
Example 
ERROR: Error fetching remote repo 'jenkins_tmp'
hudson.plugins.git.GitException: Failed to fetch from binary_tmp@147.75.72.255:binary_tmp.git
	at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1003)
	at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1244)
	at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1308)
	at hudson.scm.SCM.checkout(SCM.java:540)

Build Failure

Reason FATAL: Connection timed out
Type BUILD_FAILURE
Failed PR 25 (nodejs/node#44412, nodejs/node#44756, nodejs/node#44436, nodejs/node#44690, nodejs/node#44726, nodejs/node#44250, nodejs/node#44758, nodejs/node#41276, nodejs/node#44675, nodejs/node#44775, nodejs/node#44739, nodejs/node#44782, nodejs/node#44774, nodejs/node#44754, nodejs/node#44741, nodejs/node#44779, nodejs/node#44769, nodejs/node#44685, nodejs/node#44686, nodejs/node#44683, nodejs/node#44689, nodejs/node#44778, nodejs/node#44763, nodejs/node#44696, nodejs/node#44693)
Appeared test-equinix-ubuntu2204-x64-1, test-packetnet-ubuntu1804-x64-1, test-ibm-ubuntu1804-x64-1, test-packetnet-ubuntu1804-x64-2, test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46731/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46786/
Example 
FATAL: Connection timed out
java.net.ConnectException: Connection timed out
	at java.base/sun.nio.ch.Net.connect0(Native Method)
	at java.base/sun.nio.ch.Net.connect(Net.java:579)
	at java.base/sun.nio.ch.Net.connect(Net.java:568)
	at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:588)
Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 6 (https://github.com/nodejs-private/node-private/pull/350/, nodejs/node#44758, nodejs/node#44250, nodejs/node#44739, nodejs/node#44782, nodejs/node#44689)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46699/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46780/
Example 
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp
Reason Error: socket hang up
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs-private/node-private/pull/352/, nodejs/node#44412, nodejs/node#44754, nodejs/node#44436, nodejs/node#44739)
Appeared test-digitalocean-ubuntu1804-x64-1, test-digitalocean-alpine311_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46708/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46750/
Example 
Error: socket hang up
    at connResetException (node:internal/errors:711:14)
    at TLSSocket.socketCloseListener (node:_http_client:461:25)
    at TLSSocket.emit (node:events:525:35)
    at node:net:298:12
    at TCP.done (node:_tls_wrap:587:7) {
Reason ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs-private/node-private/pull/342/, https://github.com/nodejs-private/node-private/pull/348/, https://github.com/nodejs-private/node-private/pull/352/, https://github.com/nodejs-private/node-private/pull/350/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-3, test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2017-x64-4, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2012r2_vs2013-x64-1, test-azure_msft-win10_vs2019-x64-2, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2017-x64-3, test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2013-x64-2, test-rackspace-win2012r2_vs2015-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46700/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46720/
Example 
ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Reason error: The last gc run reported the following. Please correct the root cause
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#44690, nodejs/node#44739, nodejs/node#44758, nodejs/node#44741)
Appeared test-digitalocean-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46737/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46771/
Example 
error: The last gc run reported the following. Please correct the root cause
and remove .git/gc.log.
Automatic cleanup will not be performed until the file is removed.

warning: There are too many unreachable loose objects; run 'git prune' to remove them.
Reason FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from ... Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#44758, nodejs/node#44412)
Appeared test-equinix-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46730/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46731/
Example 
FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838": Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down
java.nio.channels.ClosedChannelException
	at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:155)
	at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:143)
	at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:789)
	at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#44744, https://github.com/nodejs-private/node-private/pull/348/)
Appeared test-packetnet-ubuntu1804-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46697/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46710/
Example 
Failed to trigger node-test-commit

undefined

Reason Unknown
Type undefined
Failed PR 6 (nodejs/node#44739, nodejs/node#44758, nodejs/node#44779, nodejs/node#44741, nodejs/node#44763, nodejs/node#44696)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/46738/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46785/
Example 
Unknown

Progress

  • sequential/test-cpu-prof-drained (5)
  • parallel/test-worker-heap-snapshot (3)
  • sequential/test-cpu-prof-dir-relative (3)
  • sequential/test-watch-mode-inspect (3)
  • parallel/test-crypto-key-objects (2)
  • parallel/test-http2-misbehaving-multiplex (2)
  • sequential/test-perf-hooks (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (3)
  • Build timed out (after 60 minutes). Marking the build as failed. (2)
  • ERROR: Error fetching remote repo 'jenkins_tmp' (10)
  • FATAL: Connection timed out (25)
  • error: remote GitHub already exists. (6)
  • Error: socket hang up (5)
  • ERROR: Step �Publish JUnit test result report� failed: No test report files were found. Configuration error? (4)
  • error: The last gc run reported the following. Please correct the root cause (4)
  • FATAL: Channel "hudson.remoting.Channel@6008869b:JNLP4-connect connection from ... Remote call on JNLP4-connect connection from 147.75.72.255/147.75.72.255:36838 failed. The channel is closing down or has closed down (2)
  • Failed to trigger node-test-commit (2)
  • Unknown (6)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions