Dump state and block data upon app hash or last results mismatch and create script to replay

[evan-forbes]

Upon a app hash mismatch or last results hash mismatch, it would be useful to dump the state and the block data so that we can use a script to replay the non-determinism in order to debug it faster

[tac0turtle]

this was added via celestiaorg/celestia-app#4453. do you still want a last results hash mismatch script?

[evan-forbes]

this issue is for dumping the state and block data for easier debugging, that issue looks like its only adding a log statement, is that accurate?

[tac0turtle]

it would log all the stores so you can compare which store is the issue, then you would use something like https://github.com/orijtech/chdbg to inspect the db. You want to avoid dumping state to json as this consumes immense amount of memory. This is why the testnet command modifies the db instead of json for mainnet to local testing. If we want something to dump state, it can be implemented?