Upgrade to Cardano `10.4`

[jpraynaud]

Why

A new version of the Cardano node has been released: 10.4.1. We need to update this dependency in all our code base and make sure that Mithril nodes are compatible with it.

What

Upgrade the Cardano node (and Cardano cli) to 10.4.1 on Mithril networks infrastructure and devnet.

How

• Check if ledger state needs to be recomputed with new Cardano node 10.4.1
  • 🔥 Upgrade of the ledger state snapshot is needed (or warmup phase), see Release 2524 distribution #2488
• Update Cardano configurations in infra
  • preview
  • preprod
  • mainnet
• Cleanup previous unsupported Cardano configurations in infra
• Check that we can start Cardano node 10.4.1 on all networks with the new configuration
  • preview
  • preprod
  • mainnet
• Check if the latest stable version of the Mithril aggregator and signer are compatible with new Cardano node 10.4.1:
  • Signer ✅
  • Aggregator ✅ (will be fixed in Adapt ledger state snapshot artifact creation in Cardano database certification #2497)
• Update the Cardano cli to 10.4.1 in the infrastructure
• Update the Cardano cli to 10.4.1 in the Docker images
• Update the Cardano cli to 10.4.1 in the documentation
• Update the Cardano node version to 10.4.1 in CI manual/nightly workflows
• Add new entry in the E2E test in the CI for 10.4.1
• Update the Cardano node and cli to 10.4.1 in the devnet
• Update the Cardano node and cli to 10.4.1 in the E2E test
• Update the networks.json files
• Update the 'Network configurations' page
  • testing-preview
  • pre-release-preview
  • release-preprod
  • release-mainnet
• Update the Cardano node version to 10.4.1 in the GitHub environments
  • dev-preview
  • dev-follower-preview
  • dev-mainnet
  • testing-preview
  • pre-release-preview will be done in Release 2524 distribution #2488
  • release-preprod will be done in Release 2524 distribution #2488
  • release-mainnet will be done in Release 2524 distribution #2488

[jpraynaud]

Script to convert ledger state snapshot when upgrading to 10.4.1:

• Phase 1: prepare the converted ledger state snapshot

----------------- START PHASE 1
## Env vars
export CARDANO_NETWORK=preview
export CARDANO_VERSION=10.4.1
export TEMP_DIR=/home/curry/temp
export CARDANO_DIR=/home/curry/data/${CARDANO_NETWORK}/mithril-aggregator/cardano
export CARDANO_CONFIG_FILE=${TEMP_DIR}/share/${CARDANO_NETWORK}/config.json
export CARDANO_LEDGER_DIR=${CARDANO_DIR}/db/ledger
export CARDANO_LEDGER_SLOT=$(ls $CARDANO_LEDGER_DIR | head -n 1)
echo "LEDGER_SLOT=$CARDANO_LEDGER_SLOT"

## Create temp dir
mkdir -p $TEMP_DIR

## Copy ledger state snapshot to temp
cp ${CARDANO_LEDGER_DIR}/${CARDANO_LEDGER_SLOT} $TEMP_DIR
tree $CARDANO_LEDGER_DIR
tree $TEMP_DIR

## Download snapshot converter
cd $TEMP_DIR
curl --fail -sL -o cardano-node-${CARDANO_VERSION}-linux.tar.gz https://github.com/IntersectMBO/cardano-node/releases/download/${CARDANO_VERSION}/cardano-node-${CARDANO_VERSION}-linux.tar.gz
tar xzf cardano-node-${CARDANO_VERSION}-linux.tar.gz
tree $TEMP_DIR

## Convert snasphot
$TEMP_DIR/bin/snapshot-converter Legacy ${TEMP_DIR}/${CARDANO_LEDGER_SLOT} Mem ${TEMP_DIR}/${CARDANO_LEDGER_SLOT}_mem cardano --config $CARDANO_CONFIG_FILE
tree ${TEMP_DIR}/${CARDANO_LEDGER_SLOT}_mem

----------------- END PHASE 1 

• Phase 2: use the converted ledger state snapshot

----------------- START PHASE 2

## Stop cardano node
docker stop cardano-node-aggregator

# Switch to new ledger state snapshot
rm -rf ${CARDANO_LEDGER_DIR}/*
cp -r ${TEMP_DIR}/${CARDANO_LEDGER_SLOT}_mem ${CARDANO_LEDGER_DIR}/${CARDANO_LEDGER_SLOT}
tree ${CARDANO_LEDGER_DIR}/

## Start cardano node
docker start cardano-node-aggregator

## Cleanup temp dir
cd /home/curry
rm -rf $TEMP_DIR

----------------- END PHASE 1