Polygon Mainnet: "block has less receipts than expected"

[kcy1019]

System information

Erigon version: maticnetwork/v0.0.4(based on v2.31.0)

OS & Version: Linux

Commit hash : de5391602c810c28e8c71b86efbc6c04e61b39d3

Expected behaviour

We can retrieve transaction reciepts using jsonrpc API:

curl -XPOST 'http://localhost:8545' \
     -H 'Content-Type: application/json' \
     --data '{"method":"eth_getTransactionReceipt","params":["0x31ce15ce9a1ff347f4204a1ed3625861165c53ae08743c1f36a32865c62744c6"],"id":1,"jsonrpc":"2.0"}'

Actual behaviour

{"jsonrpc":"2.0","id":1,"error":{"code":-32000,"message":"block has less receipts than expected: 0 \u003c= 0, block: 36635776"}}

Note that we haven't encountered this kind of errors in maticnetwork/v0.0.3(which seems to be based on somewhere around v2022.08.01).

Steps to reproduce the behaviour

1. Sync Erigon maticnetwork/v0.0.3 for Polygon Mainnet
2. Upgrade binary to maticnetwork/v0.0.4
3. Request API:

   curl -XPOST 'http://localhost:8545' \
        -H 'Content-Type: application/json' \
        --data '{"method":"eth_getTransactionReceipt","params": 
   ["0x31ce15ce9a1ff347f4204a1ed3625861165c53ae08743c1f36a32865c62744c6"],"id":1,"jsonrpc":"2.0"}'

We tried the above steps twice and it consistently reproduced the problem.

NOTES

• eth_getBlockReceipts works fine for the block number, so at least we have a workaround.

Backtrace

N/A

[kcy1019]

We’ve also found that eth_getTransactionByHash is also having trouble retrieving some Polygon State Sync transactions such as 0xd5f4f8c3cd85cf65e8df23a2c1ae02aefda1e6293db0c3a9ddcc08cee8ca1131, and eth_getBlockByNumber can be a workaround.

Possible fix: #6286

Failure

$ curl -XPOST 'http://localhost:8545' \
     -H 'Content-Type: application/json' \
     --data '{"method":"eth_getTransactionByHash","params":["0xd5f4f8c3cd85cf65e8df23a2c1ae02aefda1e6293db0c3a9ddcc08cee8ca1131"],"id":1,"jsonrpc":"2.0"}'
{"jsonrpc":"2.0","id":1,"result":null}

Workaround: eth_getBlockByNumber

$ curl -XPOST 'http://localhost:8545' \
     -H 'Content-Type: application/json' \
     --data '{"method":"eth_getBlockByNumber","params":["36647936",true],"id":1,"jsonrpc":"2.0"}'
# (works fine, returns correct information about the transaction)