Block range is too large when querying default RPC for Optimism Sepolia

[PaulRBerg]

The default RPC for Optimism Sepolia is https://sepolia.optimism.io.

When indexing it, we are getting a lot of errors like this:

Block range is too large

Toggle to see full error log

[22:11:34.618] WARN (43804): Failed getting data for the block range. Will try smaller block range for the next attempt.
    chainId: 11155420
    logType: "Block Range Query"
    partitionId: "0"
    source: "RPC (sepolia.optimism.io)"
    fromBlock: 29170974
    addresses: 6
    retry: 5
    toBlock: 29173325
    backOffMilliseconds: 5000
    err: {
      "type": "Error",
      "message": "could not coalesce error (error={ \"code\": -32062, \"data\": { \"trace_id\": \"af2eeafc9a1ed2f6adb2b72532977335\" }, \"message\": \"Block range is too large\" }, payload={ \"id\": 32, \"jsonrpc\": \"2.0\", \"method\": \"eth_getLogs\", \"params\": [ { \"address\": [ \"0x0a881bbd71a21710d56ff1931ec8189d94019d60\", \"0x1f898895eab949ffd34c29cf859c035dc4525df4\", \"0x89ec3830040dec63e9df0c904d649fda4d49df16\", \"0xb971a93608413c54f407ee86c7c15b295e0004bb\", \"0xe59d28bef2d37e99b93e734ed1ddcfc4b9c1bf73\", \"0xf9e4095c1dfc058b34135c5c48cae66a8d2b3aa5\" ], \"fromBlock\": \"0x1bd1d1e\", \"toBlock\": \"0x1bd264d\", \"topics\": [ [ \"0x075861cbceafeb777e8f15f357121b08f6f3adba387d599bb7b5278ca6192df5\", \"0x0eb069207093cd3e51cd1370d2d369770057fbe29947e577e5fb428c6c6fc78f\", \"0x17307eab39ab6107e8899845ad3d59bd9653f200f220920489ca2b5937696c31\", \"0x1cb15a39f12b6a349f8d1d45499b7b9df63464a79fa2e294a7237107e62c384f\", \"0x33eb09bbf19ea3fb22c760d5164234f8bf62ca07dcf5a437ad389e96b0bd6443\", \"0x40b88e5c41c5a97ffb7b6ef88a0a2d505aa0c634cf8a0275cb236ea7dd87ed4d\", \"0x44cb432df42caa86b7ec73644ab8aec922bc44c71c98fc330addc75b88adbc7c\", \"0x5edb27d6c1a327513b90a792050debf074b7194444885e3144d4decc5caaaa50\", \"0x7cb83640a329cb238b531daa26ffca31b59dd7c51020184cb4394ac43a11278c\", \"0x8c5be1e5ebec7d5bd14f71427d1e84f3dd0314c0f7b2291e5b200ac8c7c3b925\", \"0xcf6da1cdefbf0f0870377128cab020f3b9895ce9613b14b933bbd193d764a92e\", \"0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef\", \"0xef3d668acee46576ad5d407c42ab4d0cde13f3cd70b28f09a0fb9e3bf5bf09cb\", \"0xfeb1cb9ce021c8bd5fb1eb836e6284c68866fa32d1d844238de19955238f8076\" ] ] } ] }, code=UNKNOWN_ERROR, version=6.8.0)",
      "stack":
          Error: could not coalesce error (error={ "code": -32062, "data": { "trace_id": "af2eeafc9a1ed2f6adb2b72532977335" }, "message": "Block range is too large" }, payload={ "id": 32, "jsonrpc": "2.0", "method": "eth_getLogs", "params": [ { "address": [ "0x0a881bbd71a21710d56ff1931ec8189d94019d60", "0x1f898895eab949ffd34c29cf859c035dc4525df4", "0x89ec3830040dec63e9df0c904d649fda4d49df16", "0xb971a93608413c54f407ee86c7c15b295e0004bb", "0xe59d28bef2d37e99b93e734ed1ddcfc4b9c1bf73", "0xf9e4095c1dfc058b34135c5c48cae66a8d2b3aa5" ], "fromBlock": "0x1bd1d1e", "toBlock": "0x1bd264d", "topics": [ [ "0x075861cbceafeb777e8f15f357121b08f6f3adba387d599bb7b5278ca6192df5", "0x0eb069207093cd3e51cd1370d2d369770057fbe29947e577e5fb428c6c6fc78f", "0x17307eab39ab6107e8899845ad3d59bd9653f200f220920489ca2b5937696c31", "0x1cb15a39f12b6a349f8d1d45499b7b9df63464a79fa2e294a7237107e62c384f", "0x33eb09bbf19ea3fb22c760d5164234f8bf62ca07dcf5a437ad389e96b0bd6443", "0x40b88e5c41c5a97ffb7b6ef88a0a2d505aa0c634cf8a0275cb236ea7dd87ed4d", "0x44cb432df42caa86b7ec73644ab8aec922bc44c71c98fc330addc75b88adbc7c", "0x5edb27d6c1a327513b90a792050debf074b7194444885e3144d4decc5caaaa50", "0x7cb83640a329cb238b531daa26ffca31b59dd7c51020184cb4394ac43a11278c", "0x8c5be1e5ebec7d5bd14f71427d1e84f3dd0314c0f7b2291e5b200ac8c7c3b925", "0xcf6da1cdefbf0f0870377128cab020f3b9895ce9613b14b933bbd193d764a92e", "0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef", "0xef3d668acee46576ad5d407c42ab4d0cde13f3cd70b28f09a0fb9e3bf5bf09cb", "0xfeb1cb9ce021c8bd5fb1eb836e6284c68866fa32d1d844238de19955238f8076" ] ] } ] }, code=UNKNOWN_ERROR, version=6.8.0)
              at makeError (/Users/prb/Sablier/indexers/src/envio/lockup/bindings/node_modules/.pnpm/ethers@6.8.0/node_modules/ethers/src.ts/utils/errors.ts:694:21)
              at JsonRpcProvider.getRpcError (/Users/prb/Sablier/indexers/src/envio/lockup/bindings/node_modules/.pnpm/ethers@6.8.0/node_modules/ethers/src.ts/providers/provider-jsonrpc.ts:976:25)
              at /Users/prb/Sablier/indexers/src/envio/lockup/bindings/node_modules/.pnpm/ethers@6.8.0/node_modules/ethers/src.ts/providers/provider-jsonrpc.ts:526:45
              at processTicksAndRejections (node:internal/process/task_queues:105:5)
      "code": "UNKNOWN_ERROR",
      "error": {
        "type": "Object",
        "message": "Block range is too large",
        "stack":
            
        "code": -32062,
        "data": {
          "trace_id": "af2eeafc9a1ed2f6adb2b72532977335"
        }
      },
      "payload": {
        "method": "eth_getLogs",
        "params": [
          {
            "address": [
              "0x0a881bbd71a21710d56ff1931ec8189d94019d60",
              "0x1f898895eab949ffd34c29cf859c035dc4525df4",
              "0x89ec3830040dec63e9df0c904d649fda4d49df16",
              "0xb971a93608413c54f407ee86c7c15b295e0004bb",
              "0xe59d28bef2d37e99b93e734ed1ddcfc4b9c1bf73",
              "0xf9e4095c1dfc058b34135c5c48cae66a8d2b3aa5"
            ],
            "topics": [
              [
                "0x075861cbceafeb777e8f15f357121b08f6f3adba387d599bb7b5278ca6192df5",
                "0x0eb069207093cd3e51cd1370d2d369770057fbe29947e577e5fb428c6c6fc78f",
                "0x17307eab39ab6107e8899845ad3d59bd9653f200f220920489ca2b5937696c31",
                "0x1cb15a39f12b6a349f8d1d45499b7b9df63464a79fa2e294a7237107e62c384f",
                "0x33eb09bbf19ea3fb22c760d5164234f8bf62ca07dcf5a437ad389e96b0bd6443",
                "0x40b88e5c41c5a97ffb7b6ef88a0a2d505aa0c634cf8a0275cb236ea7dd87ed4d",
                "0x44cb432df42caa86b7ec73644ab8aec922bc44c71c98fc330addc75b88adbc7c",
                "0x5edb27d6c1a327513b90a792050debf074b7194444885e3144d4decc5caaaa50",
                "0x7cb83640a329cb238b531daa26ffca31b59dd7c51020184cb4394ac43a11278c",
                "0x8c5be1e5ebec7d5bd14f71427d1e84f3dd0314c0f7b2291e5b200ac8c7c3b925",
                "0xcf6da1cdefbf0f0870377128cab020f3b9895ce9613b14b933bbd193d764a92e",
                "0xddf252ad1be2c89b69c2b068fc378daa952ba7f163c4a11628f55a4df523b3ef",
                "0xef3d668acee46576ad5d407c42ab4d0cde13f3cd70b28f09a0fb9e3bf5bf09cb",
                "0xfeb1cb9ce021c8bd5fb1eb836e6284c68866fa32d1d844238de19955238f8076"
              ]
            ],
            "fromBlock": "0x1bd1d1e",
            "toBlock": "0x1bd264d"
          }
        ],
        "id": 32,
        "jsonrpc": "2.0"
      },
      "shortMessage": "could not coalesce error"
    }

Warp link: https://app.warp.dev/block/GbOuPk2Nf1m0DPaHTrqXQD

Ditto for Morph L2 and Ethereum Sepolia:

https://app.warp.dev/block/N8AwugNkns4x4gXVMuMUW3

Envio config YAML used: https://github.com/sablier-labs/indexers/blob/1a5fe8bb30082d93d75131c968672dc3d9da5375/src/envio/lockup/config.yaml

[PaulRBerg]

It's also not clear to me why Optimism Sepolia RPC is even queried in the first place. Is HyperSync down for Optimism Sepolia?

Related: #597

Potentially related: #263

[PaulRBerg]

I think I figured it out.

I found these links:

• "Exceed maximum block range: 5000" on contract.queryFilter ethers-io/ethers.js#1816
• Indexing error: eth_getLogs uses toBlock less than fromBlock #263 (comment)

As @JonoPrest explained here, the fix is to set interval_ceiling to 5000.

Any thoughts about using this value (5000) as a default for non-Hypersync RPC URLs? It looks like many default RPC servers use 5000 as a maximum block range.

[DZakh]

It should automatically retry with a smaller block range. What can be improved is not to attempt block ranges in the future which obviously don't work.

[DZakh]

I'm closing this for now.