Progress Tracking for In-Place Store Migrations

[tomtau]

Summary

Right now, there is no feedback on the progress of in-place store migrations during network upgrades, hence node operators may be puzzled whether something went wrong.

Problem Definition

If a store migration is executed on a large state, it could take a long time. On existing large production networks on low spec or archival nodes, this can lead to a node being stuck at a single log entry for hours:

INF applying upgrade "..." at height: ...

This can be confusing to a node operator who does not know when to expect the upgrade to complete or whether the upgrade is making any progress or something went wrong.

Proposal

It would be good to add some additional logging (e.g. which modules are being migrated) or potentially some new functionality to allow tracking migration progress (e.g. how many entry out of total entries were migrated).

Related: #9928 #10047

---

For Admin Use

• Not duplicate issue
• Appropriate labels applied
• Appropriate contributors tagged
• Contributor assigned/self-assigned

[amaury1093]

Good idea! @tomtau would you like to create a PR?

[tomtau]

Good idea! @tomtau would you like to create a PR?

I can add some extra logging; for the additional tracking, I'm not sure of what the best way is (store migrations can add their logging individually, but not sure whether it's worth having something generic that works across them)