Skip to content

Tracking: full backlog in batches (A: spawn fixes, B: adapter cost caps, C: changelog gate, D: lagotto, E: deferred) #655

Open

Description

@scttfrdmn

Organizing the full backlog into batches. Scope: all of it, agreed 2026-10-04. Batches are independent and can land in any order; only Batch A gates the spawn release.


Batch A — spawn core fixes (gates the spawn release)

Batch B — cost-cap the workflow adapters (cost safety, cross-repo)

No adapter emits lifecycle.cost_limit. TTL is the only ceiling in every integration, and the expensive failure is a job that hangs rather than fails — nothing retries or aborts it, and nothing else stops the spend. Worst case per fan-out is N × TTL × rate.

  • snakemake-executor-plugin-spawn#12 — container + cost_limit (in progress)
  • snakemake-executor-plugin-spawn#13 — not on PyPI; unpinned Snakemake/storage specs resolved per job
  • nf-spawn#100 — cost_limit
  • miniwdl-spawn#12 — cost_limit
  • cwl-spawn#12 — cost_limit
  • airflow-spawn#12 — cost_limit
  • airflow-spawn#13 — container (the only adapter missing both)
  • pegasus-spawn#5 — cost_limit (prototype: the example builds its own spec, so likely a docs/example fix)

Batch C — changelog gate propagation (6 Go repos + 3 missing CHANGELOGs)

Only spawn has the gate; 18 of 19 repos lack it. In spawn it has caught a duplicate group three times in one session, so it earns its keep. Shared Go implementation (changelog_test.go + a CI step), copied.

  • lagotto, libs, truffle, spore-host-mcp
  • spore-host-plugin-globus, spore-host-plugin-tailscale
  • CHANGELOG.md missing entirely — spore-plugins, spore-host-plugin-rstudio, spore-host-plugin-spore-sync. Suite policy says every repo keeps one, so these are violations today.

Out of scope here, noted for follow-up: the Python adapters, nf-spawn (Groovy), pegasus-spawn (Shell), calque, cohort — each needs a separate non-Go implementation.

Batch D — lagotto

  • lagotto#172 — GoReleaser builds the capacity-poller from main.go

Batch E — deferred by agreement (do NOT block the release)


Landed this session

#637, #645, #564, #565, #620-docs, #616, #639, #632, #642 — and the live production reaper redeployed from 75.7 MiB to 25.2 MiB with zero config drift and all 16 stack parameters preserved (DryRun=false intact, i.e. still armed).

Activity

  1. changed the title [-]Tracking: pre-release cleanup across the tools touched this session[/-] [+]Tracking: full backlog in batches (A: spawn fixes, B: adapter cost caps, C: changelog gate, D: lagotto, E: deferred)[/+] on Oct 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions