Skip to content

Consistent crash "FATAL SIGNAL 11 RECEIVED" after catch-up #1114

@sadilek

Description

@sadilek

My daemon is consistently crashing since a few days after having caught up with the blockchain. I have pulled the latest updates and rebuilt several times. Last crash was at commit 58fae47.

crash.log:

+14186.849070555 lightningd(9833):DEBUG: Adding block 511107: 0000000000000000001845d43505e86dde6bdbf55fce9b8325d9619a2200901c
+14189.756722369 lightning_gossipd(9841):DEBUG: Received channel_update for channel 510308:736:0(0) now ACTIVE
+14189.756828585 lightning_gossipd(9841):DEBUG: Received channel_update for channel 509559:411:0(0) now ACTIVE
+14189.756915298 lightning_gossipd(9841):DEBUG: Received channel_update for channel 506088:2414:0(0) now ACTIVE
+14189.756972321 lightning_gossipd(9841):DEBUG: Received channel_update for channel 507064:1108:1(1) now ACTIVE
+14189.830532269 lightningd(9833):BROKEN: FATAL SIGNAL 11 RECEIVED
+14189.841756223 lightningd(9833):BROKEN: backtrace: lightningd/log.c:504 (log_crash) 0x414f40
+14189.841841556 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0x7f0eba0d84af
+14189.841877372 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0x7f0eba0f1cc0
+14189.841900682 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0x7f0eba119a48
+14189.842038474 lightningd(9833):BROKEN: backtrace: ccan/ccan/tal/str/str.c:67 (do_vfmt) 0x46a61c
+14189.842068225 lightningd(9833):BROKEN: backtrace: ccan/ccan/tal/str/str.c:91 (tal_vfmt) 0x46a6dc
+14189.842103494 lightningd(9833):BROKEN: backtrace: lightningd/log.c:264 (logv) 0x41435a
+14189.842128505 lightningd(9833):BROKEN: backtrace: lightningd/log.c:320 (log_) 0x4146da
+14189.842471909 lightningd(9833):BROKEN: backtrace: lightningd/peer_control.c:534 (funding_lockin_cb) 0x421a16
+14189.842679274 lightningd(9833):BROKEN: backtrace: lightningd/watch.c:221 (txw_fire) 0x429d4f
+14189.842701448 lightningd(9833):BROKEN: backtrace: lightningd/watch.c:289 (watch_topology_changed) 0x429fb3
+14189.842977929 lightningd(9833):BROKEN: backtrace: lightningd/chaintopology.c:335 (updates_complete) 0x406ed1
+14189.842997248 lightningd(9833):BROKEN: backtrace: lightningd/chaintopology.c:429 (get_new_block) 0x407346
+14189.843299464 lightningd(9833):BROKEN: backtrace: lightningd/bitcoind.c:657 (process_getblockhash) 0x405535
+14189.843319911 lightningd(9833):BROKEN: backtrace: lightningd/bitcoind.c:186 (bcli_finished) 0x403fb7
+14189.843485216 lightningd(9833):BROKEN: backtrace: ccan/ccan/io/poll.c:183 (destroy_conn) 0x4610b1
+14189.843503984 lightningd(9833):BROKEN: backtrace: ccan/ccan/io/poll.c:189 (destroy_conn_close_fd) 0x4610d1
+14189.843773033 lightningd(9833):BROKEN: backtrace: ccan/ccan/tal/tal.c:240 (notify) 0x46b720
+14189.843791471 lightningd(9833):BROKEN: backtrace: ccan/ccan/tal/tal.c:400 (del_tree) 0x46bbd1
+14189.843829697 lightningd(9833):BROKEN: backtrace: ccan/ccan/tal/tal.c:509 (tal_free) 0x46bfe4
+14189.844019283 lightningd(9833):BROKEN: backtrace: ccan/ccan/io/io.c:443 (io_close) 0x45fd39
+14189.844038381 lightningd(9833):BROKEN: backtrace: ccan/ccan/io/poll.c:314 (io_loop) 0x4614c0
+14189.844248188 lightningd(9833):BROKEN: backtrace: lightningd/lightningd.c:403 (main) 0x413644
+14189.844266654 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0x7f0eba0c382f
+14189.844371345 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0x4033f8
+14189.844388414 lightningd(9833):BROKEN: backtrace: (null):0 ((null)) 0xffffffffffffffff

stdout:

2018-02-27T05:55:47.283Z lightningd(9833): 0273081ce642554d5a68a5236564fe88a3783457dc09e52812517f5724f36daefd chan #89: State changed from FUNDING_SPEND_SEEN to ONCHAIN
2018-02-27T05:59:00.167Z lightningd(9833): FATAL SIGNAL 11 RECEIVED
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: lightningd/log.c:504 (log_crash) 0x414f40
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: (null):0 ((null)) 0x7f0eba0d84af
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: (null):0 ((null)) 0x7f0eba0f1cc0
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: (null):0 ((null)) 0x7f0eba119a48
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: ccan/ccan/tal/str/str.c:67 (do_vfmt) 0x46a61c
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: ccan/ccan/tal/str/str.c:91 (tal_vfmt) 0x46a6dc
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: lightningd/log.c:264 (logv) 0x41435a
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: lightningd/log.c:320 (log_) 0x4146da
2018-02-27T05:59:00.178Z lightningd(9833): backtrace: lightningd/peer_control.c:534 (funding_lockin_cb) 0x421a16
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/watch.c:221 (txw_fire) 0x429d4f
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/watch.c:289 (watch_topology_changed) 0x429fb3
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/chaintopology.c:335 (updates_complete) 0x406ed1
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/chaintopology.c:429 (get_new_block) 0x407346
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/bitcoind.c:657 (process_getblockhash) 0x405535
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: lightningd/bitcoind.c:186 (bcli_finished) 0x403fb7
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: ccan/ccan/io/poll.c:183 (destroy_conn) 0x4610b1
2018-02-27T05:59:00.179Z lightningd(9833): backtrace: ccan/ccan/io/poll.c:189 (destroy_conn_close_fd) 0x4610d1
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: ccan/ccan/tal/tal.c:240 (notify) 0x46b720
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: ccan/ccan/tal/tal.c:400 (del_tree) 0x46bbd1
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: ccan/ccan/tal/tal.c:509 (tal_free) 0x46bfe4
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: ccan/ccan/io/io.c:443 (io_close) 0x45fd39
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: ccan/ccan/io/poll.c:314 (io_loop) 0x4614c0
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: lightningd/lightningd.c:403 (main) 0x413644
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: (null):0 ((null)) 0x7f0eba0c382f
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: (null):0 ((null)) 0x4033f8
2018-02-27T05:59:00.180Z lightningd(9833): backtrace: (null):0 ((null)) 0xffffffffffffffff
Fatal signal 11. 0x415026 log_crash
        lightningd/log.c:530
0x7f0eba0d84af ???
        ???:0
0x7f0eba0f1cc0 ???
        ???:0
0x7f0eba119a48 ???
        ???:0
0x46a61c do_vfmt
        ccan/ccan/tal/str/str.c:67
0x46a6dc tal_vfmt
        ccan/ccan/tal/str/str.c:91
0x41435a logv
        lightningd/log.c:264
0x4146da log_
        lightningd/log.c:320
0x421a16 funding_lockin_cb
        lightningd/peer_control.c:534
0x429d4f txw_fire
        lightningd/watch.c:221
0x429fb3 watch_topology_changed
        lightningd/watch.c:289
0x406ed1 updates_complete
        lightningd/chaintopology.c:335
0x407346 get_new_block
        lightningd/chaintopology.c:429
0x405535 process_getblockhash
        lightningd/bitcoind.c:657
0x403fb7 bcli_finished
        lightningd/bitcoind.c:186
0x4610b1 destroy_conn
        ccan/ccan/io/poll.c:183
0x4610d1 destroy_conn_close_fd
        ccan/ccan/io/poll.c:189
0x46b720 notify
        ccan/ccan/tal/tal.c:240
0x46bbd1 del_tree
        ccan/ccan/tal/tal.c:400
0x46bfe4 tal_free
        ccan/ccan/tal/tal.c:509
0x45fd39 io_close
        ccan/ccan/io/io.c:443
0x4614c0 io_loop
        ccan/ccan/io/poll.c:314
0x413644 main
        lightningd/lightningd.c:403
0x7f0eba0c382f ???
        ???:0
0x4033f8 ???
        ???:0
0xffffffffffffffff ???
        ???:0
Log dumped in crash.log

getinfo:

{ "id" : "036487e0bd981617c674c2856fc0050472a0182838e0a4a1a67545c6cdee9f49a0", "port" : 9735, "address" : 
	[ 
		{ "type" : "ipv4", "address" : "81.6.40.158", "port" : 9735 } ], "version" : "v0.5.2-2016-11-21-2125-g58fae47", "blockheight" : 510777, "network" : "bitcoin" }

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions