Parity taking days to (fail to) sync on warp-barrier

[LDMFD]

I'm running:

• Which Parity version?: v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
• Which operating system?: Ubuntu 16.06 (recently installed)
• How installed?: sudo bash <(curl https://get.parity.io -kL)
• Are you fully synchronized?: no
• Which network are you connected to?: ethereum (default)
• Did you try to restart the node?: yes

Parity taking days to (fail to) sync despite multiple restarts as follows:

1. Initial run started with canonical parity - cancelled after a couple of days, deleted ~/.local/share/io.parity.ethereum

2. parity --mode active --tracing off --pruning fast --db-compaction ssd --cache-size 1024 - again cancelled, deleted parity dir and then:

3. parity --db-compaction ssd --cache-size 1024 --warp-barrier 5520000

This last execution was left running for 48 hours and the last line of the log at that point:

2018-05-02 15:52:13 Syncing #4179651 a017…7492 5 blk/s 434 tx/s 28 Mgas/s 0+ 453 Qed #4180107 25/25 peers 66 MiB chain 393 MiB db 43 MiB queue 13 MiB sync RPC: 0 conn, 0 req/s, 44057 µs

My system specs are as follows:

CPU: Intel i7 6700K
GPU: GeForce GTX 1060 6GB
RAM: 16GB DDR4 SDRAM
HD: 128GB M.2 SSD
Internet: 950 Mb/s down, 120 Mb/s up, fiber
Clock is synced. 8GB swapfile is 152M used.

StackExchange discussion here, https://ethereum.stackexchange.com/questions/46950/parity-sync-time-april-2018-many-days-normal

Raising a bug as requested by Tbaut. I would be happy to help with diagnosis and testing.

Thank you,

Darren

[LDMFD]

Having deleted the data dir and restarted with only parity --warp-barrier 5520000, I'm going to copy here some of the output. Perhaps there will be something obviously wrong here:

darren@dubuntu:~$ parity --warp-barrier 5520000
2018-05-02 16:15:17  Starting Parity/v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
2018-05-02 16:15:17  Keys path /home/darren/.local/share/io.parity.ethereum/keys/Foundation
2018-05-02 16:15:17  DB path /home/darren/.local/share/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d
2018-05-02 16:15:17  Path to dapps /home/darren/.local/share/io.parity.ethereum/dapps
2018-05-02 16:15:17  State DB configuration: fast
2018-05-02 16:15:17  Operating mode: active
2018-05-02 16:15:17  Configured for Foundation using Ethash engine
2018-05-02 16:15:17  Updated conversion rate to Ξ1 = US$674.47 (7060217.5 wei/gas)
2018-05-02 16:15:22  Public node URL: enode://1fc338abaac538bbac456806d14515e5478712425f6586b0c384c7d13a83a127d16bf5bfac846f1fb76e69686fb5946eb5a5214d8bd0cb42b5a89350bfac421b@192.168.0.125:30303
2018-05-02 16:15:37  Syncing snapshot 0/1315        #0    6/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 16:15:42  Syncing snapshot 0/1315        #0    6/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 16:15:52  Syncing snapshot 6/1315        #0    7/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 16:15:57  Syncing snapshot 12/1315        #0    7/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-02 16:28:12  Syncing snapshot 51/1315        #0   16/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-02 17:45:37  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-02 19:43:28  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-02 22:58:07  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:58:17  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:58:22  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:58:32  Syncing snapshot 51/1315        #0   26/50 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:58:42  Imported #254 47e6…0bb6 (0 txs, 0.00 Mgas, 0.12 ms, 1.05 KiB)
2018-05-02 22:58:42  Updated conversion rate to Ξ1 = US$705.51 (6749592.5 wei/gas)
2018-05-02 22:58:52  Imported #255 c631…3ff9 (0 txs, 0.00 Mgas, 0.34 ms, 0.53 KiB)
2018-05-02 22:59:02  Syncing   #12066 f893…1d37   393 blk/s    0 tx/s   0 Mgas/s  15639+    0 Qed    #27705   23/25 peers   0 bytes chain 56 MiB db 25 MiB queue 6 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:12  Syncing   #18179 c2f6…647a   600 blk/s    0 tx/s   0 Mgas/s  17197+ 5370 Qed    #40786   25/25 peers   3 MiB chain 73 MiB db 37 MiB queue 7 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:22  Syncing   #24317 31ce…7211   624 blk/s    0 tx/s   0 Mgas/s      0+21558 Qed    #45877   25/25 peers   6 MiB chain 73 MiB db 35 MiB queue 19 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:28  Syncing   #26329 46b0…4fc2   315 blk/s    0 tx/s   0 Mgas/s      0+34267 Qed    #60598   25/25 peers   5 MiB chain 73 MiB db 64 MiB queue 8 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:35  Syncing   #28419 83f3…e708   306 blk/s    0 tx/s   0 Mgas/s      0+32179 Qed    #60598   25/25 peers   6 MiB chain 73 MiB db 60 MiB queue 8 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:42  Syncing   #36826 1acb…d89d  1134 blk/s    0 tx/s   0 Mgas/s      0+23771 Qed    #60598   25/25 peers   4 MiB chain 73 MiB db 46 MiB queue 8 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:53  Syncing   #44362 6a31…10c3   725 blk/s    0 tx/s   0 Mgas/s      0+22077 Qed    #66440   24/25 peers   5 MiB chain 73 MiB db 46 MiB queue 11 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 22:59:53  Syncing   #44366 abf2…ca2b     0 blk/s    0 tx/s   0 Mgas/s      0+22073 Qed    #66440   24/25 peers   5 MiB chain 73 MiB db 46 MiB queue 11 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-02 23:00:07  Syncing   #48820 9823…293a   319 blk/s   97 tx/s   2 Mgas/s      0+
...
2018-05-03 02:06:00  Syncing #1660440 7cbb…9818    70 blk/s  332 tx/s  12 Mgas/s      0+ 5100 Qed  #1665543   26/50 peers   6 MiB chain 108 MiB db 41 MiB queue 9 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-03 14:33:52    25/25 peers   4 MiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
... 4 days later
...
2018-05-07 17:10:43  Syncing #4592611 c5f3…a764     2 blk/s  186 tx/s   8 Mgas/s      0+  540 Qed  #4593155   25/25 peers   5 MiB chain 257 MiB db 40 MiB queue 58 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:10:53  Syncing #4592623 eb06…01c4     1 blk/s   51 tx/s   2 Mgas/s      0+  528 Qed  #4593155   25/25 peers   5 MiB chain 257 MiB db 40 MiB queue 58 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:11:03  Syncing #4592652 861d…61f0     2 blk/s  242 tx/s  14 Mgas/s      0+  534 Qed  #4593189   25/25 peers   5 MiB chain 257 MiB db 40 MiB queue 72 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:11:13  Syncing #4592707 66ce…c191     5 blk/s  439 tx/s  22 Mgas/s      0+ 1939 Qed  #4594650   25/25 peers   5 MiB chain 257 MiB db 155 MiB queue 59 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:11:23  Syncing #4592734 6ec7…9af8     2 blk/s  262 tx/s  13 Mgas/s      0+ 1915 Qed  #4594650   25/25 peers   5 MiB chain 257 MiB db 152 MiB queue 59 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:11:33  Syncing #4592785 d569…187f     5 blk/s  390 tx/s  21 Mgas/s      0+ 1863 Qed  #4594650   25/25 peers   5 MiB chain 257 MiB db 148 MiB queue 59 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:11:43  Syncing #4592832 ece6…2cf7     4 blk/s  329 tx/s  17 Mgas/s      0+ 1815 Qed  #4594650   25/25 peers   6 MiB chain 258 MiB db 145 MiB queue 59 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
^C2018-05-07 17:11:49  Finishing work, please wait...
darren@dubuntu:~$ parity
2018-05-07 17:12:38  Starting Parity/v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
2018-05-07 17:12:38  Keys path /home/darren/.local/share/io.parity.ethereum/keys/Foundation
2018-05-07 17:12:38  DB path /home/darren/.local/share/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d
2018-05-07 17:12:38  Path to dapps /home/darren/.local/share/io.parity.ethereum/dapps
2018-05-07 17:12:38  State DB configuration: fast
2018-05-07 17:12:38  Operating mode: active
2018-05-07 17:12:38  Configured for Foundation using Ethash engine
2018-05-07 17:12:38  Updated conversion rate to Ξ1 = US$760.96 (6257759 wei/gas)
2018-05-07 17:12:44  Public node URL: enode://7e2acbd21a0761079e622d06620c12fe775ee72dcfcb6eab3bd0d78cafff5090a07cf99d14942196943ca23cbf0e247aa53d80d0cebc6451c059c5eec8464999@192.168.0.125:30303
2018-05-07 17:12:49  Syncing snapshot 2/1326  #4592843   23/25 peers   91 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:12:59  Syncing snapshot 8/1326  #4592843   25/25 peers   91 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
^C2018-05-07 17:13:01  Finishing work, please wait...
^[[Adarren@dubuntu^C
darren@dubuntu:~$ parity --warp-barrier 5520000
2018-05-07 17:13:23  Starting Parity/v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
2018-05-07 17:13:23  Keys path /home/darren/.local/share/io.parity.ethereum/keys/Foundation
2018-05-07 17:13:23  DB path /home/darren/.local/share/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d
2018-05-07 17:13:23  Path to dapps /home/darren/.local/share/io.parity.ethereum/dapps
2018-05-07 17:13:23  State DB configuration: fast
2018-05-07 17:13:23  Operating mode: active
2018-05-07 17:13:23  Configured for Foundation using Ethash engine
2018-05-07 17:13:23  Updated conversion rate to Ξ1 = US$761.47 (6253569 wei/gas)
2018-05-07 17:13:28  Public node URL: enode://7e2acbd21a0761079e622d06620c12fe775ee72dcfcb6eab3bd0d78cafff5090a07cf99d14942196943ca23cbf0e247aa53d80d0cebc6451c059c5eec8464999@192.168.0.125:30303
2018-05-07 17:13:33  Syncing snapshot 0/1326  #4592843   22/25 peers   91 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:13:43  Syncing snapshot 7/1326  #4592843   24/25 peers   91 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-07 17:39:33  Syncing snapshot 286/1326  #4592843   24/25 peers   605 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-07 17:44:18  Syncing snapshot 323/1326  #4592843   25/25 peers   605 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:44:28  Syncing snapshot 324/1326  #4592843   25/25 peers   605 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:44:38  Syncing snapshot 324/1326  #4592843   24/25 peers   605 KiB chain 65 MiB db 0 bytes queue 10 KiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:45:49  Syncing #4592847 da0b…438d     0 blk/s    1 tx/s   0 Mgas/s   1151+  731 Qed  #4594750   14/25 peers   627 KiB chain 66 MiB db 98 MiB queue 13 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:46:13  Syncing #4592847 da0b…438d     0 blk/s    0 tx/s   0 Mgas/s      0+ 1903 Qed  #4594750   19/25 peers   627 KiB chain 66 MiB db 154 MiB queue 13 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 17:46:43  Syncing #4592847 da0b…438d     0 blk/s    0 tx/s   0 Mgas/s      0+ 1899 Qed  #4594750   21/25 peers   627 KiB chain 66 MiB db 153 MiB queue 13 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
...
2018-05-07 23:21:04  Syncing #4638378 9e67…8ecc     1 blk/s  164 tx/s   7 Mgas/s      0+  660 Qed  #4639039   25/25 peers   5 MiB chain 105 MiB db 72 MiB queue 16 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 23:21:14  Syncing #4638390 73c7…480a     1 blk/s  149 tx/s   6 Mgas/s      0+  648 Qed  #4639039   25/25 peers   5 MiB chain 105 MiB db 70 MiB queue 16 MiB sync  RPC:  0 conn,  0 req/s,   0 µs
2018-05-07 23:21:25  Syncing #4638398 9b2d…04bc     0 blk/s   78 tx/s   4 Mgas/s      0+  640 Qed  #4639039   25/25 peers   5 MiB chain 105 MiB db 69 MiB queue 16 MiB sync  RPC:  0 conn,  0 req/s,   0 µs

[Tbaut]

cc: @dvdplm, @ngotchac and @tomusdrw

[JSterling8]

Same here. Seems to start with warp sync, then switches to full sync.

• Which Parity version?: v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
• Which operating system?: Ubuntu 16.06
• How installed?: Downloaded .deb from GitHub -> Ubuntu Software Manager installed
• Are you fully synchronized?: no
• Which network are you connected to?: ethereum (default)
• Did you try to restart the node?: yes

My system specs are as follows:

CPU: Intel® Core™ i7-7500U CPU @ 2.70GHz × 4
GPU: N/A
RAM: 16GB
HD: 512GB SSD
Internet: 50 Mb/s down, 20 Mb/s up, fiber

Output:

➜  ~ git:(master) ✗ parity --db-compaction ssd --cache-size 1024 --warp-barrier 5520000 ui
2018-05-06 16:52:35  Parity browser interface is deprecated. It's going to be removed in the next version, use standalone Parity UI instead.
2018-05-06 16:52:35  Standalone Parity UI: https://github.com/Parity-JS/shell/releases
2018-05-06 16:52:35  Starting Parity/v1.10.2-beta-f4ae813-20180423/x86_64-linux-gnu/rustc1.25.0
2018-05-06 16:52:35  Keys path /home/jsterling8/.local/share/io.parity.ethereum/keys/Foundation
2018-05-06 16:52:35  DB path /home/jsterling8/.local/share/io.parity.ethereum/chains/ethereum/db/906a34e69aec8c0d
2018-05-06 16:52:35  Path to dapps /home/jsterling8/.local/share/io.parity.ethereum/dapps
2018-05-06 16:52:35  State DB configuration: fast
2018-05-06 16:52:35  Operating mode: active
2018-05-06 16:52:35  Configured for Foundation using Ethash engine

Open: http://127.0.0.1:8180/#/auth?token=<REDACTED>
to authorize your browser.
Or use the generated token:
<REDACTED>
2018-05-06 16:52:36  Public node URL: enode://3108a412f3b3f8c2001802ca22aa8c81aa8a3f22536d5839379c44354a06d23fd82af268ca2067c1bce5e553890c95da514cc03e6063e5c5c2d10412db5847e8@192.168.1.155:30303
Created new window in existing browser session.
[657:670:0506/165236.412743:ERROR:browser_gpu_channel_host_factory.cc(119)] Failed to launch GPU process.
2018-05-06 16:52:37  Updated conversion rate to Ξ1 = US$774.46 (6148677 wei/gas)
2018-05-06 16:53:01  Syncing snapshot 0/1337        #0    2/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  1 conn,  1 req/s,  51 µs
2018-05-06 16:53:11  Syncing snapshot 2/1337        #0    3/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  1 conn,  1 req/s,  51 µs
...
2018-05-06 16:55:41  Syncing snapshot 21/1337        #0    7/25 peers   8 KiB chain 3 MiB db 0 bytes queue 10 KiB sync  RPC:  1 conn,  2 req/s, 198 µs
2018-05-06 16:55:51  Syncing       #0 d4e5…8fa3     0 blk/s    0 tx/s   0 Mgas/s    123+    0 Qed      #127    4/25 peers   8 KiB chain 3 MiB db 234 KiB queue 73 KiB sync  RPC:  1 conn,  1 req/s, 229 µs
2018-05-06 16:55:56  Syncing    #1524 3d94…7253   304 blk/s    0 tx/s   0 Mgas/s      2+    0 Qed     #1527    6/25 peers   2 MiB chain 11 MiB db 4 KiB queue 419 KiB sync  RPC:  1 conn,  4 req/s, 198 µs
2018-05-06 16:56:06  Syncing    #1781 2f92…6a9a    25 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed     #1781    7/25 peers   2 MiB chain 11 MiB db 0 bytes queue 5 MiB sync  RPC:  1 conn,  3 req/s,  80 µs
2018-05-06 16:56:16  Syncing    #1781 2f92…6a9a     0 blk/s    0 tx/s   0 Mgas/s      0+    0 Qed     #1781    7/25 peers   2 MiB chain 11 MiB db 0 bytes queue 9 MiB sync  RPC:  1 conn,  1 req/s,  80 µs

[JSterling8]

CTRL+C'ing then rerunning with the same command appears to be working now. At snapshot 365 of 1337 at present. Will update if it completes or switches back to full syncing again.

[JSterling8]

Just got a full sync. Total time about 2.5 hours. @cachvico - Instead of deleting ~/.local/share/io.parity.ethereum and restarting, simply CTRL+C then run again with the same params. I used: parity --db-compaction ssd --cache-size 1024 --warp-barrier 5520000

[LDMFD]

I have restarted first with parity (accidentally) then parity --warp-barrier 5520000. I've updated my log (in the second post in this thread) with the complete output appended.

[JSterling8]

@cachvico - Does it get further for you now after the restart? Mine didn't complete the first time, but completed on the first restart.

[LDMFD]

@JSterling8 not really - still only up to #4638589

I've updated my log at #8531 (comment)

[ngotchac]

This issue should be fixed with #8543 (and improved with #8544) 🙂

[LDMFD]

Great!

Which branch should I build from to pick up the fix? (Or, when's the next release that includes it?)

Thanks

[ngotchac]

@cachvico You can try ng-warp-resume