test failed in CI: test_omdb_success_cases #9048
Description
This test failed on a CI run on #9046:
https://github.com/oxidecomputer/omicron/pull/9046/checks?check_run_id=50722020516
Log showing the specific test failure:
Excerpt from the log showing the failure:
8373 2025-09-18T20:53:49.957Z FAIL [ 61.362s] omicron-omdb::test_all_output test_omdb_success_cases
8374 2025-09-18T20:53:49.957Z stdout ───
8375 2025-09-18T20:53:49.957Z
8376 2025-09-18T20:53:49.957Z running 1 test
8377 2025-09-18T20:53:49.957Z running commands with args: ["db", "disks", "list"]
8378 2025-09-18T20:53:49.957Z running commands with args: ["db", "dns", "show"]
8379 2025-09-18T20:53:49.957Z running commands with args: ["db", "dns", "diff", "external", "2"]
8380 2025-09-18T20:53:49.957Z running commands with args: ["db", "dns", "names", "external", "2"]
8381 2025-09-18T20:53:49.957Z running commands with args: ["db", "instances"]
8382 2025-09-18T20:53:49.957Z running commands with args: ["db", "sleds"]
8383 2025-09-18T20:53:49.957Z running commands with args: ["db", "sleds", "-F", "discretionary"]
8384 2025-09-18T20:53:49.957Z running commands with args: ["mgs", "inventory"]
8385 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "doc"]
8386 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "--no-executing-info"]
8387 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "saga_recovery", "--no-executing-info"]
8388 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "blueprint_loader", "blueprint_executor", "--no-executing-info"]
8389 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "dns_internal", "--no-executing-info"]
8390 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "dns_external", "--no-executing-info"]
8391 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "background-tasks", "show", "all", "--no-executing-info"]
8392 2025-09-18T20:53:49.957Z running commands with args: ["nexus", "sagas", "list"]
8393 2025-09-18T20:53:49.957Z running commands with args: ["--destructive", "nexus", "sagas", "demo-create"]
8394 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "sagas", "list"]
8395 2025-09-18T20:53:49.958Z running commands with args: ["--destructive", "nexus", "background-tasks", "activate", "inventory_collection"]
8396 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "blueprints", "list"]
8397 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "blueprints", "show", "9ac33ebc-315a-4542-9829-76d398dbc127"]
8398 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "blueprints", "show", "current-target"]
8399 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "blueprints", "diff", "9ac33ebc-315a-4542-9829-76d398dbc127", "current-target"]
8400 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "blueprints", "diff", "9ac33ebc-315a-4542-9829-76d398dbc127"]
8401 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "reconfigurator-config", "show", "current"]
8402 2025-09-18T20:53:49.958Z running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--planner-enabled", "true"]
8403 2025-09-18T20:53:49.958Z running commands with args: ["-w", "nexus", "reconfigurator-config", "set", "--add-zones-with-mupdate-override", "true"]
8404 2025-09-18T20:53:49.958Z running commands with args: ["nexus", "reconfigurator-config", "show", "current"]
8405 2025-09-18T20:53:49.958Z running commands with args: ["reconfigurator", "export", "/var/tmp/omicron_tmp/.tmp0qqqzm/reconfigurator-export.out"]
8406 2025-09-18T20:53:49.958Z test test_omdb_success_cases has been running for over 60 seconds
8407 2025-09-18T20:53:49.958Z @@ -1262,19 +1262,31 @@
8408 2025-09-18T20:53:49.958Z
8409 2025-09-18T20:53:49.958Z task: "sp_ereport_ingester"
8410 2025-09-18T20:53:49.958Z configured period: every <REDACTED_DURATION>s
8411 2025-09-18T20:53:49.958Z last completed activation: <REDACTED ITERATIONS>, triggered by <TRIGGERED_BY_REDACTED>
8412 2025-09-18T20:53:49.958Z started at <REDACTED_TIMESTAMP> (<REDACTED DURATION>s ago) and ran for <REDACTED DURATION>ms
8413 2025-09-18T20:53:49.958Z -/!\ errors: 1
8414 2025-09-18T20:53:49.958Z - - failed to resolve MGS addresses: proto error: no records found for Query { name: Name("_mgs._tcp.control-plane.oxide.internal."), query_type: SRV, query_class: IN }
8415 2025-09-18T20:53:49.958Z - total ereports received: 0
8416 2025-09-18T20:53:49.958Z - new ereports ingested: 0
8417 2025-09-18T20:53:49.958Z - total HTTP requests sent: 0
8418 2025-09-18T20:53:49.958Z - total collection errors: 0
8419 2025-09-18T20:53:49.958Z - reporters with ereports: 0
8420 2025-09-18T20:53:49.958Z + total ereports received: 11
8421 2025-09-18T20:53:49.958Z + new ereports ingested: 11
8422 2025-09-18T20:53:49.958Z + total HTTP requests sent: 8
8423 2025-09-18T20:53:49.958Z + total collection errors: 8
8424 2025-09-18T20:53:49.958Z + reporters with ereports: 4
8425 2025-09-18T20:53:49.958Z reporters with collection errors: 0
8426 2025-09-18T20:53:49.958Z
8427 2025-09-18T20:53:49.958Z + service processors:
8428 2025-09-18T20:53:49.958Z + - sled 00: 6 ereports
8429 2025-09-18T20:53:49.958Z + new ereports ingested: 6
8430 2025-09-18T20:53:49.958Z + HTTP requests sent: 2
8431 2025-09-18T20:53:49.958Z + - sled 01: 2 ereports
8432 2025-09-18T20:53:49.958Z + new ereports ingested: 2
8433 2025-09-18T20:53:49.959Z + HTTP requests sent: 2
8434 2025-09-18T20:53:49.959Z + - switch 00: 2 ereports
8435 2025-09-18T20:53:49.959Z + new ereports ingested: 2
8436 2025-09-18T20:53:49.959Z + HTTP requests sent: 2
8437 2025-09-18T20:53:49.959Z + - switch 01: 1 ereports
8438 2025-09-18T20:53:49.959Z + new ereports ingested: 1
8439 2025-09-18T20:53:49.959Z + HTTP requests sent: 2
8440 2025-09-18T20:53:49.959Z +
8441 2025-09-18T20:53:49.959Z task: "support_bundle_collector"
8442 2025-09-18T20:53:49.959Z configured period: every <REDACTED_DURATION>days <REDACTED_DURATION>h <REDACTED_DURATION>m <REDACTED_DURATION>s
8443 2025-09-18T20:53:49.959Z last completed activation: <REDACTED ITERATIONS>, triggered by <TRIGGERED_BY_REDACTED>
8444 2025-09-18T20:53:49.959Z started at <REDACTED_TIMESTAMP> (<REDACTED DURATION>s ago) and ran for <REDACTED DURATION>ms
8445 2025-09-18T20:53:49.959Z Support Bundle Cleanup Report:
8446 2025-09-18T20:53:49.959Z
8447 2025-09-18T20:53:49.959Z test test_omdb_success_cases ... FAILED
8448 2025-09-18T20:53:49.959Z
8449 2025-09-18T20:53:49.959Z failures:
8450 2025-09-18T20:53:49.959Z
8451 2025-09-18T20:53:49.959Z failures:
8452 2025-09-18T20:53:49.959Z test_omdb_success_cases
8453 2025-09-18T20:53:49.959Z
8454 2025-09-18T20:53:49.959Z test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 2 filtered out; finished in 60.78s