How to serialize to disk for cardano-cli tx view?

[ross-spencer]

Previously it was straightforward to serialize a pycardano transaction to disk for view in cardano-cli.

Given the following example successfully published: https://preprod.cexplorer.io/tx/61fb61071e942d230f8efad20352e1652075b7892b6298262386cfb44c2ad950?tab=overview

And visible here:

{
    "type": "Witnessed Tx BabbageEra",
    "description": "Ledger Cddl Format",
    "cborHex": "84a500d9010281825820f1bab595d976dcc0c9b9356d10cabd364516f204c417832d7eb7350fa1a17992010182825839002c55bc8f20e402d3a5f87d362a653f2b5dec94a37652fea8723ab350abbcbed52f93d9c547a456690b62e448e7bb9e105d0e6f545f9209d31a000f4240825839002c55bc8f20e402d3a5f87d362a653f2b5dec94a37652fea8723ab350abbcbed52f93d9c547a456690b62e448e7bb9e105d0e6f545f9209d31b0000000253d50bb3021a0002938d031a066c614a081a066c533aa100d9010281825820dcaa0d643fda34e794231ef3bb7b9885bffa13c0a43f83867b1d8f0b21d493bf584079d178b55116a32496922131506330763437d79e2a5271860d92e738f78b0abede43acfe45dd20b92a14f25a28d6ab5b210f8e9481b18f0a02f5655679ef7803f5f6"
}

I now get the error when trying to interpret it:

cardano-cli debug transaction view --tx-file tx_claim.signed 
Failed to decode the ledger's CDDL serialisation format. TextEnvelopeCddl error: tx_claim.signed: TextEnvelopeCDDL CBOR decoding error: DecoderErrorDeserialiseFailure "Shelley Tx" (DeserialiseFailure 3 "expected list len or indef")

Does anyone have any tips/ideas about what may be wrong?

Code snippet below. Again, it successfully builds and submits a transaction, something seems incorrect in the CBOR (at least from cardano-cli's perspective.

    # ogmios context
    transaction = pyc.TransactionBuilder(config.context)

    transaction.add_input_address(
        pyc.Address.from_primitive(str(library.payment_address))
    )

    transaction.add_output(
        pyc.TransactionOutput.from_primitive([str(library.payment_address), ada_amount])
    )

    transaction.validity_start = config.context.last_block_slot

    transaction.ttl = transaction.validity_start + 3600

    signed_tx = transaction.build_and_sign(
        [library.payment_skey],
        change_address=pyc.Address.from_primitive(str(library.payment_address)),
    )

    # serialize here...

[cffls]

Pycardano is able to decode this transaction correctly:

tx = Transaction.from_cbor("84a500d9010281825820f1bab595d976dcc0c9b9356d10cabd364516f204c417832d7eb7350fa1a17992010182825839002c55bc8f20e402d3a5f87d362a653f2b5dec94a37652fea8723ab350abbcbed52f93d9c547a456690b62e448e7bb9e105d0e6f545f9209d31a000f4240825839002c55bc8f20e402d3a5f87d362a653f2b5dec94a37652fea8723ab350abbcbed52f93d9c547a456690b62e448e7bb9e105d0e6f545f9209d31b0000000253d50bb3021a0002938d031a066c614a081a066c533aa100d9010281825820dcaa0d643fda34e794231ef3bb7b9885bffa13c0a43f83867b1d8f0b21d493bf584079d178b55116a32496922131506330763437d79e2a5271860d92e738f78b0abede43acfe45dd20b92a14f25a28d6ab5b210f8e9481b18f0a02f5655679ef7803f5f6")
tx
{
  'auxiliary_data': None,
  'transaction_body': {
    'auxiliary_data_hash': None,
    'certificates': None,
    'collateral': None,
    'collateral_return': None,
    'current_treasury_value': None,
    'donation': None,
    'fee': 168845,
    'inputs': OrderedSet([{
      'index': 1,
      'transaction_id': TransactionId(hex='f1bab595d976dcc0c9b9356d10cabd364516f204c417832d7eb7350fa1a17992'),
    }]),
    'mint': None,
    'network_id': None,
    'outputs': [
      {
        'address': addr_test1qqk9t0y0yrjq95a9lp7nv2n98u44mmy55dm99l4gwgatx59thjld2tunm8z50fzkdy9k9ezgu7aeuyzapeh4ghujp8fsn57waw,
        'amount': {'coin': 1000000, 'multi_asset': {}},
        'datum': None,
        'datum_hash': None,
        'post_alonzo': False,
        'script': None,
      },
      {
        'address': addr_test1qqk9t0y0yrjq95a9lp7nv2n98u44mmy55dm99l4gwgatx59thjld2tunm8z50fzkdy9k9ezgu7aeuyzapeh4ghujp8fsn57waw,
        'amount': {'coin': 9996405683, 'multi_asset': {}},
        'datum': None,
        'datum_hash': None,
        'post_alonzo': False,
        'script': None,
      },
    ],
    'proposal_procedures': None,
    'reference_inputs': None,
    'required_signers': None,
    'script_data_hash': None,
    'total_collateral': None,
    'ttl': 107766090,
    'update': None,
    'validity_start': 107762490,
    'voting_procedures': None,
    'withdraws': None,
  },
  'transaction_witness_set': {
    'bootstrap_witness': None,
    'native_scripts': None,
    'plutus_data': None,
    'plutus_v1_script': None,
    'plutus_v2_script': None,
    'plutus_v3_script': None,
    'redeemer': None,
    'vkey_witnesses': NonEmptyOrderedSet([{
      'signature': '79d178b55116a32496922131506330763437d79e2a5271860d92e738f78b0abede43acfe45dd20b92a14f25a28d6ab5b210f8e9481b18f0a02f5655679ef7803',
      'vkey': 'dcaa0d643fda34e794231ef3bb7b9885bffa13c0a43f83867b1d8f0b21d493bf',
    }]),
  },
  'valid': True,
}

I suspect it is because the EmptyOrderedSet/NonEmptyOrderedSet introduced in the Chang/Plomin HF.

Is your cardano-cli up to date?

[ross-spencer]

Up to date on my end (see below) were you able to try it against your version?

$ cardano-cli version
cardano-cli 10.11.0.0 - linux-x86_64 - ghc-9.6
git rev ca1ec278070baf4481564a6ba7b4a5b9e3d9f366
$ cardano-node version
cardano-node 10.5.1 - linux-x86_64 - ghc-9.6
git rev ca1ec278070baf4481564a6ba7b4a5b9e3d9f366
$ which cardano-cli
/home/ross-spencer/cardano/cardano-node/bin/cardano-cli
$ which cardano-node
/home/ross-spencer/cardano/cardano-node/bin/cardano-node
$ cardano-cli debug transaction view --tx-file tx_claim.signed 
Failed to decode the ledger's CDDL serialisation format. TextEnvelopeCddl error: tx_claim.signed: TextEnvelopeCDDL CBOR decoding error: DecoderErrorDeserialiseFailure "Shelley Tx" (DeserialiseFailure 3 "expected list len or indef")

[cffls]

I am using the same version of cardano-cli and getting the same error as well. The transaction has been submitted successfully and included in the ledger, which means there is nothing wrong with the transaction. Otherwise, it wouldn't been failed and not included by the ledger. Due to this reason, it seems like a bug in cardano-cli instead of pycardano. I would suggest creating an issue or ask this question in cardano-node repo.