Can't keep peer count above min

[gaia]

Before filing a new issue, please provide the following information.

I'm running:

• Which Parity version?: 1.8.6
• Which operating system?: Ubuntu
• How installed?: curl
• Are you fully synchronized?: yes
• Which network are you connected to?: ethereum
• Did you try to restart the node?: yes

been running 1.8.5 with no problems since it was released. peer count was always at max peers or very close to it. since installing 1.8.6 (node has been synced for months, only stopped a few seconds) parity constantly drops below min peers.

i saw the "Please note, that the initial database compaction after upgrading might temporarily reduce the node's performance." but node performance includes peers connected?

[parity]
base_path = "/mnt/ethereum/io.parity.ethereum"
db_path = "/mnt/ethereum/io.parity.ethereum/chains"
keys_path = "$HOME/.local/share/io.parity.ethereum/keys"

[network]
min_peers = 20
max_peers = 40

[footprint]
pruning = "fast"
pruning_history = 64
db_compaction = "ssd"

Jan 10 23:07:52 example.com parity[7594]: 2018-01-10 23:07:52  Imported #4889458 6fa8…c365 (56 txs, 1.19 Mgas, 266.45 ms, 6.73 KiB)
Jan 10 23:08:19 example.com parity[7594]: 2018-01-10 23:08:19  Imported #4889459 c0b1…aa1f (113 txs, 7.99 Mgas, 523.31 ms, 31.44 KiB)
Jan 10 23:08:41 example.com parity[7594]: 2018-01-10 23:08:41    25/40 peers    224 KiB chain  111 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  2 req/s, 7395 µs
Jan 10 23:08:43 example.com parity[7594]: 2018-01-10 23:08:43  Imported #4889460 2d62…e353 (163 txs, 8.00 Mgas, 479.30 ms, 23.10 KiB)
Jan 10 23:08:57 example.com parity[7594]: 2018-01-10 23:08:57  Imported #4889461 3f88…9993 (307 txs, 7.99 Mgas, 626.78 ms, 37.46 KiB)
Jan 10 23:09:04 example.com parity[7594]: 2018-01-10 23:09:04  Imported #4889463 b72f…5509 (159 txs, 8.00 Mgas, 729.15 ms, 28.04 KiB) + another 1 block(s) containing 90 tx(s)
Jan 10 23:09:16 example.com parity[7594]: 2018-01-10 23:09:16    36/40 peers     19 MiB chain  112 MiB db 776 bytes queue   71 KiB sync  RPC:  2 conn,  4 req/s, 139 µs
Jan 10 23:09:36 example.com parity[7594]: 2018-01-10 23:09:36  Imported #4889464 161a…ae54 (144 txs, 8.00 Mgas, 437.09 ms, 25.87 KiB)
Jan 10 23:09:46 example.com parity[7594]: 2018-01-10 23:09:46  Imported #4889467 9b8d…a06e (157 txs, 8.00 Mgas, 507.49 ms, 29.25 KiB)
Jan 10 23:09:55 example.com parity[7594]: 2018-01-10 23:09:55    18/20 peers      4 MiB chain  112 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  1 req/s, 127 µs
Jan 10 23:10:31 example.com parity[7594]: 2018-01-10 23:10:31    18/20 peers      5 MiB chain  112 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  1 req/s, 140 µs
Jan 10 23:11:06 example.com parity[7594]: 2018-01-10 23:11:06     6/20 peers      6 MiB chain  112 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  2 req/s, 138 µs
Jan 10 23:11:19 example.com parity[7594]: 2018-01-10 23:11:19  Reorg to #4889468 b802…a9fa (9b8d…a06e #4889466 b708…aabf f42e…3606)
Jan 10 23:11:24 example.com parity[7594]: 2018-01-10 23:11:24  Imported #4889470 636c…15b1 (293 txs, 7.96 Mgas, 1130.40 ms, 37.64 KiB) + another 2 block(s) containing 535 tx(s)
Jan 10 23:11:37 example.com parity[7594]: 2018-01-10 23:11:37  Imported #4889473 8bcc…e2b8 (248 txs, 5.73 Mgas, 503.62 ms, 28.95 KiB) + another 1 block(s) containing 280 tx(s)
Jan 10 23:11:48 example.com parity[7594]: 2018-01-10 23:11:48    15/20 peers      8 KiB chain  113 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 171 µs
Jan 10 23:12:38 example.com parity[7594]: 2018-01-10 23:12:38    12/20 peers      2 MiB chain  112 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  1 req/s, 101 µs
Jan 10 23:12:39 example.com parity[7594]: 2018-01-10 23:12:39    12/20 peers      5 MiB chain  112 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  2 req/s, 101 µs
Jan 10 23:12:53 example.com parity[7594]: 2018-01-10 23:12:53    11/20 peers      5 MiB chain  112 MiB db 776 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 101 µs
Jan 10 23:13:00 example.com parity[7594]: 2018-01-10 23:13:00  Imported #4889475 329a…6c85 (61 txs, 1.45 Mgas, 143.55 ms, 7.52 KiB) + another 1 block(s) containing 192 tx(s)
Jan 10 23:13:02 example.com parity[7594]: 2018-01-10 23:13:02  Imported #4889469 e58f…5f97 (247 txs, 7.98 Mgas, 446.68 ms, 33.19 KiB)
Jan 10 23:13:52 example.com parity[7594]: 2018-01-10 23:13:52     5/20 peers      8 MiB chain  113 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 123 µs
Jan 10 23:13:52 example.com parity[7594]: 2018-01-10 23:13:52     5/20 peers      6 MiB chain  113 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 123 µs
Jan 10 23:13:52 example.com parity[7594]: 2018-01-10 23:13:52     5/20 peers      6 MiB chain  113 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 123 µs
Jan 10 23:13:52 example.com parity[7594]: 2018-01-10 23:13:52     5/20 peers      6 MiB chain  113 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 123 µs
Jan 10 23:14:07 example.com parity[7594]: 2018-01-10 23:14:07  Syncing #4889475 329a…6c85     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4889475   10/20 peers      4 MiB chain  113 MiB db  0 bytes queue   78 KiB sync  RPC:  2 conn,  1 req/s, 140 µs
Jan 10 23:14:31 example.com parity[7594]: 2018-01-10 23:14:31  Imported #4889485 e95a…d4c7 (188 txs, 7.97 Mgas, 980.32 ms, 28.97 KiB)
Jan 10 23:15:06 example.com parity[7594]: 2018-01-10 23:15:06     8/20 peers      9 MiB chain  115 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  1 req/s, 141 µs
Jan 10 23:15:07 example.com parity[7594]: 2018-01-10 23:15:07     8/20 peers      5 MiB chain  115 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  1 req/s, 139 µs
Jan 10 23:15:09 example.com parity[7594]: 2018-01-10 23:15:09     7/20 peers      5 MiB chain  115 MiB db  0 bytes queue   71 KiB sync  RPC:  2 conn,  0 req/s, 139 µs

[gabririgo]

+1 same with kovan testnet, even after closing parity my machine is unusable and have to restart it

[gaia]

12 hrs later, it is still going down below min peers (3)

[petejkim]

I am experiencing the same.

[gaia]

did a db kill, resyncing, will report back

[gaia]

db kill seems to help so far (it's remains close to 250 max peers).
also deleted nodes.conf just to clean it up

[petejkim]

I delete nodes.conf every time I restart Parity - helps initially but starts dropping peers soon after.

[tzapu]

i have noticed that peer count stays to some "reasonable" numbers while syncing but immediately drops when in sync. is there something that would explain or help with this?

/edit: this was on a clean sync started this morning on 1.8.6

cheers

2018-01-12 13:38:08 UTC Syncing #4896275 3be3…d22b     1 blk/s  218 tx/s   8 Mgas/s      0+   35 Qed  #4896304   35/100 peers    177 MiB chain  255 MiB db    7 MiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:38:15 UTC Reorg to #4896285 64ae…9edf (8bec…fe8d #4896283 f627…b4e2 7ad0…8a32)
2018-01-12 13:38:18 UTC Syncing #4896289 1e0a…4682     1 blk/s  340 tx/s  11 Mgas/s      0+   19 Qed  #4896304   35/100 peers    178 MiB chain  255 MiB db    4 MiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:38:20 UTC Reorg to #4896292 13e2…a1fd (e0de…625c #4896290 0e99…3332 38e4…cdf7)
2018-01-12 13:38:31 UTC Imported #4896304 e174…fb30 (294 txs, 8.00 Mgas, 1789.09 ms, 37.32 KiB) + another 2 block(s) containing 423 tx(s)
2018-01-12 13:38:54 UTC Imported #4896305 f9f2…0057 (190 txs, 7.99 Mgas, 775.54 ms, 35.36 KiB)
2018-01-12 13:38:56 UTC Imported #4896306 a8a8…aabf (236 txs, 8.01 Mgas, 1192.93 ms, 34.16 KiB)
2018-01-12 13:39:02 UTC   32/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:39:45 UTC Imported #4896307 819d…fbed (255 txs, 8.00 Mgas, 1360.11 ms, 34.85 KiB)
2018-01-12 13:39:49 UTC Imported #4896308 08c0…da94 (274 txs, 7.99 Mgas, 796.71 ms, 36.40 KiB)
2018-01-12 13:39:51 UTC   31/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:40:00 UTC Imported #4896307 9f8a…f14b (241 txs, 7.99 Mgas, 455.36 ms, 33.23 KiB)
2018-01-12 13:40:11 UTC Imported #4896309 e39c…63d3 (167 txs, 8.00 Mgas, 522.09 ms, 34.20 KiB)
2018-01-12 13:40:24 UTC   29/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:40:30 UTC Imported #4896310 7c51…3e72 (259 txs, 8.00 Mgas, 661.77 ms, 34.49 KiB)
2018-01-12 13:40:58 UTC   29/100 peers    179 MiB chain  260 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:41:09 UTC Imported #4896311 f19a…8d4c (322 txs, 8.00 Mgas, 830.18 ms, 39.80 KiB)
2018-01-12 13:41:21 UTC Imported #4896312 ca58…6bf5 (300 txs, 7.99 Mgas, 687.52 ms, 36.70 KiB)
2018-01-12 13:41:31 UTC Imported #4896313 fb07…dcd0 (247 txs, 7.75 Mgas, 712.99 ms, 33.17 KiB)
2018-01-12 13:41:31 UTC   27/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:41:41 UTC Imported #4896314 ab92…ae7e (318 txs, 7.97 Mgas, 554.72 ms, 38.38 KiB)
2018-01-12 13:42:03 UTC   24/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:42:45 UTC Imported #4896315 fdf8…60a3 (193 txs, 7.99 Mgas, 604.46 ms, 33.18 KiB)



2018-01-12 13:43:08 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:43:08 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:43:08 UTC Imported #4896317 539a…fce9 (299 txs, 7.96 Mgas, 1692.03 ms, 38.80 KiB)
2018-01-12 13:43:17 UTC Imported #4896318 298e…9005 (235 txs, 7.93 Mgas, 1905.31 ms, 35.02 KiB)
2018-01-12 13:43:48 UTC Imported #4896319 2362…2e07 (108 txs, 8.00 Mgas, 572.10 ms, 16.33 KiB)
2018-01-12 13:43:48 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:43:48 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:44:26 UTC Imported #4896320 d9e1…fd2e (270 txs, 7.97 Mgas, 784.48 ms, 35.46 KiB)
2018-01-12 13:44:27 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:44:28 UTC   11/100 peers    179 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:45:11 UTC Imported #4896324 8588…149f (223 txs, 8.00 Mgas, 558.00 ms, 34.50 KiB)
2018-01-12 13:45:11 UTC    9/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:45:11 UTC    9/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:45:12 UTC    9/100 peers    179 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:00 UTC Imported #4896328 826f…645d (145 txs, 7.98 Mgas, 1013.57 ms, 23.75 KiB)
2018-01-12 13:46:00 UTC    9/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:00 UTC    9/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:02 UTC    9/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:03 UTC    9/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:40 UTC Imported #4896329 3970…6c3c (227 txs, 7.98 Mgas, 609.54 ms, 30.92 KiB)
2018-01-12 13:46:41 UTC    8/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:41 UTC    8/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:41 UTC    8/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:46:41 UTC    8/100 peers    180 MiB chain  261 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:06 UTC Imported #4896331 a8db…5b15 (279 txs, 7.99 Mgas, 1973.80 ms, 38.92 KiB)
2018-01-12 13:48:08 UTC Syncing #4896331 a8db…5b15     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4896333    5/100 peers    180 MiB chain  262 MiB db 776 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:08 UTC    1/100 peers    180 MiB chain  262 MiB db   34 KiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:08 UTC    1/100 peers    180 MiB chain  262 MiB db   67 KiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:08 UTC    1/100 peers    180 MiB chain  262 MiB db   67 KiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:41 UTC Imported #4896334 ca75…956a (208 txs, 8.00 Mgas, 1790.74 ms, 30.65 KiB)
2018-01-12 13:48:41 UTC    0/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:48 UTC Syncing #4896334 ca75…956a     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4896334    1/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:48:58 UTC Syncing #4896334 ca75…956a     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4896334    1/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:49:28 UTC    0/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:49:33 UTC Syncing #4896334 ca75…956a     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed  #4896334    2/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:49:43 UTC Syncing #4896337 cf3e…d17a     0 blk/s   35 tx/s   2 Mgas/s      5+    0 Qed  #4896341    2/100 peers    180 MiB chain  262 MiB db  388 KiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:49:48 UTC Syncing #4896340 f5f4…329f     0 blk/s  136 tx/s   4 Mgas/s      2+    0 Qed  #4896341    2/100 peers    180 MiB chain  262 MiB db  162 KiB queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:49:53 UTC Reorg to #4896344 9141…97da (0ba3…c10f #4896342 7e0c…bfe5 62c6…b479)
2018-01-12 13:50:34 UTC Imported #4896344 9141…97da (133 txs, 7.98 Mgas, 1386.41 ms, 20.82 KiB)
2018-01-12 13:50:34 UTC    0/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:50:34 UTC    0/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-01-12 13:50:34 UTC    0/100 peers    180 MiB chain  262 MiB db  0 bytes queue    1 MiB sync  RPC:  0 conn,  0 req/s,   0 µs

[gaia]

I also had parity crash for the 1st time last night

Jan 11 23:48:02 example.com parity[18754]: 2018-01-11 23:48:02  Imported #4895016 9b5e…4c7d (106 txs, 7.98 Mgas, 887.59 ms, 18.07 KiB)
Jan 11 23:48:11 example.com parity[18754]: 2018-01-11 23:48:11    #3410374    9/20 peers      6 MiB chain  125 MiB db  0 bytes queue    2 GiB sync  RPC:  1 conn,  0 req/s, 135 µs
Jan 11 23:48:30 example.com parity[18754]: 2018-01-11 23:48:30  Imported #4895017 0db2…9e72 (114 txs, 8.00 Mgas, 891.80 ms, 30.75 KiB)
Jan 11 23:48:52 example.com parity[18754]: 2018-01-11 23:48:52    #3410374   15/20 peers      5 MiB chain  124 MiB db  0 bytes queue    2 GiB sync  RPC:  1 conn,  1 req/s, 135 µs
Jan 11 23:48:53 example.com parity[18754]: 2018-01-11 23:48:53    #3410374   15/20 peers      5 MiB chain  124 MiB db  0 bytes queue    2 GiB sync  RPC:  1 conn,  0 req/s, 135 µs
Jan 11 23:48:53 example.com parity[18754]: 2018-01-11 23:48:53  Imported #4895018 0068…2f5f (134 txs, 8.00 Mgas, 511.20 ms, 30.37 KiB)
Jan 11 23:49:12 example.com systemd[1]: parity.service: Main process exited, code=killed, status=9/KILL
Jan 11 23:49:12 example.com systemd[1]: parity.service: Unit entered failed state.
Jan 11 23:49:12 example.com systemd[1]: parity.service: Failed with result 'signal'.

i started it again this morning and so far it is running.

[5chdn]

I can reproduce this. This is related to the new database upgrade. #7348

Kill your old database and try again, should not happen anymore (not related to nodes.json @petejkim).

@gaia your node ran out of memory.

[gaia]

thx @5chdn. i just restarted and it hasnt crashed since.

              total        used        free      shared  buff/cache   available
Mem:           7980        2333         123         135        5523        5301
Swap:          1535        1535           0