tool: tree recovery

[j75689]

Description

Due to the introduction of the persistent SparseMerkleTree structure and support for persisting data to local (leveldb) and remote storage spaces (kvrocks, redis), we need a repair tool that can repair data when stored data is lost unexpectedly.

Structure and Data

A total of four types of tree structures (account, asset, liquidty, nft) are required for system operation. Fortunately, the system will write the hash value to the account_history, nft_history, and liquidity_history table of RDB according to the block height .

we can pass the SQL statement. e.g.

SELECT a.* FROM account_history a WHERE NOT EXISTS
	(SELECT * FROM account_history WHERE account_index = a.account_index AND l2_block_height <= ? 
        AND  l2_block_height > a.l2_block_height AND l2_block_height != -1) 
AND l2_block_height <= ? AND l2_block_height != -1 ORDER BY account_index

Read out the hash value of the corresponding height and put it back into the tree structure to generate a tree of that height.

Program

1. make a command line tool. e.g.

recovery -config ./... -height 2293 -service committer

Changes

1. refactor the SQL with gorm builder.
2. add a new tool for tree recovery.
3. batch read history table.