Skip to content

Post-M9 — eBPF completeness closure & same-workload value requalification gate #85

Description

@aetherxeg-source

Objective

Reopen the existing eBPF path as a research-only performance architecture gate for one reason only: real external ptrace workloads have now established a material stop-tax bottleneck, while the previous triggered eBPF value screen was killed before timing because the collector reported incomplete_lifecycle / incomplete_capability.

This issue does not authorize public eBPF exposure or change backend authority.

Evidence basis

  • docs/milestones/M8_8_PUBLIC_INTEGRATION_DECISION.md
  • docs/milestones/M9_1_EBPF_TRIGGER_VALUE_SCREEN_RESULT.md
  • docs/milestones/POST_M9_PTRACE_COST_ATTRIBUTION_RESULT.md
  • docs/milestones/POST_M9_PTRACE_OPTIMIZATION_BOUNDARY_DECISION.md

The current ptrace reference has a measured causal all-syscall stop tax. Two bounded native micro-optimization candidates were rejected for integration under frozen value gates. A selective-stop seccomp route is not authorized as a transparent modification of the current public ptrace backend because it changes tracee process/security state.

Immutable authority boundary

Throughout this gate:

  • native ptrace remains the public/default correctness-reference backend;
  • eBPF remains research-only;
  • eBPF learn is NOT authorized;
  • eBPF check is NOT authorized;
  • eBPF PASS authority is NOT authorized;
  • backend auto-selection is NOT authorized;
  • ptrace/eBPF baseline interchangeability is NOT authorized;
  • no public performance claim is authorized until a separately accepted value gate passes;
  • no completeness rule may be weakened to make eBPF measurements admissible.

Fixed roles

  • Linux/eBPF runtime specialist — isolate collector lifecycle/capability failure mechanisms.
  • Observation-semantics specialist — map every required evidence family against ptrace authority.
  • Performance/reproducibility engineer — freeze any later same-workload timing protocol before measurement.
  • Evidence provenance lead — bind source/run/artifact identities and preserve failures.
  • Innovation scientist / systems architect — seek a high-leverage architecture without weakening authority.
  • Deviation prevention / scientific integrity — block timing before completeness and block threshold/semantic drift.
  • Independent red team — construct lifecycle, descendant, exec, fd, path, loss and drain counterexamples.

Phase E1 — reproduce and attribute completeness failures

Before changing collector code:

  1. freeze current main source SHA;
  2. reproduce the prior failure classes on the pinned trigger workloads where practical;
  3. distinguish at minimum:
    • incomplete_lifecycle;
    • incomplete_capability;
    • dropped/lost-event state;
    • privilege/attach failure;
    • target failure;
  4. attribute each accepted incompleteness result to a concrete collector/session/capability boundary;
  5. preserve all negative runs and artifacts.

No timing value claim is admissible in E1.

Phase E2 — bounded completeness closure

Any code change must be justified by E1 attribution and must preserve fail-closed behavior.

Required properties include, where applicable:

  • root-task registration before authority is claimed;
  • descendant creation/identity propagation;
  • exec identity continuity;
  • terminal lifecycle drain;
  • explicit dropped/lost-event accounting;
  • epoch/session isolation;
  • supported capability declaration matching what was actually observed;
  • no silent conversion of unsupported/incomplete state into complete evidence;
  • privacy remains metadata-only.

Phase E3 — parity/health gate

Only after E2:

  • run controlled ptrace-vs-eBPF propositions already authorized by the existing research methodology;
  • require eBPF observations used for value testing to be complete under their declared capability surface;
  • require zero hidden loss and accepted lifecycle drain;
  • retain mismatches and unsupported propositions as negative evidence.

This gate still does not authorize public learn/check/PASS or baseline interchangeability.

Phase E4 — same-workload value requalification

Only if E1–E3 close successfully, preregister a value experiment before measurement on the same pinned real workloads that triggered the research path.

At minimum preserve:

  • same target revisions/commands;
  • same host class per comparison;
  • direct / ptrace / candidate eBPF modes as prospectively frozen;
  • fixed warmups and measured samples;
  • no outlier removal or sample replacement;
  • health/completeness prerequisites before timing acceptance;
  • exact raw artifacts.

A value claim is killed if eBPF completeness fails before accepted measured samples.

Prohibited shortcuts

  • no weakening incomplete_lifecycle or incomplete_capability definitions;
  • no treating target exit 0 as proof of complete observation;
  • no ignoring dropped events;
  • no timing incomplete observations;
  • no privilege auto-escalation in the public product;
  • no changing ptrace public semantics to make eBPF easier to match;
  • no threshold changes after measurement;
  • no deletion or relabeling of previous M8/M9 negative evidence.

First action

Read the current eBPF collector/session implementation and existing M8.3/M8.7 evidence, then produce an E1 failure-attribution record before any collector code change.

Activity

  1. aetherxeg-source commented on Sep 27, 2026

    @aetherxeg-source
    ContributorAuthor

    E1 lifecycle attribution — CLOSED

    Formal result: docs/milestones/POST_M9_EBPF_E1_LIFECYCLE_DIAGNOSTIC_RESULT.md
    Commit: 80722931e29d375f489307fcfcc3e11ec2e678b5
    Run: https://github.com/AETHERXGLOBAL/execsurface/actions/runs/36300797733

    Frozen diagnostic result:

    • casey/just: 3/3 lifecycle-drain complete, dropped events 0, exit 0; artifact 10925149811, digest sha256:d3cb40bed68ba57f129b1ead448bd7e4b18275e6bdfda6cb566988ac117d152f.
    • junegunn/fzf: 3/3 lifecycle-drain complete, dropped events 0, exit 0; artifact 10925267846, digest sha256:47073c39c2caab249e9e00fa76ea331a785c0a86a9c83393717e583b4207a31e.
    • all six runs reported only incomplete_capability, which is not a hard M9.1 lifecycle failure.

    Classification: historical intermittent lifecycle failure not reproduced in the preregistered six-run diagnostic. Previous M9.1 incomplete_lifecycle failures remain authoritative negative evidence and are not relabeled.

    No timeout increase or tracker heuristic is authorized. The old M8.4d per-invocation collector remains unsuitable for renewed value qualification because its syscall-exit membership propagation boundary had already been killed by M8.7.

    E2 direction: build a research-only value-requalification collector carrying forward the M8.7 session-epoch/root-barrier/sched_process_fork lifecycle discipline. First gate is lifecycle/health only on the same pinned workloads. No performance timing or authority change is authorized yet.

  2. aetherxeg-source commented on Sep 27, 2026

    @aetherxeg-source
    ContributorAuthor

    E2 persistent real-workload health — CLOSED / PASS

    Formal result: docs/milestones/POST_M9_EBPF_E2_PERSISTENT_REAL_WORKLOAD_HEALTH_RESULT.md
    Commit: d71284de06ac7f50ffcc163ab2c09a01cc408f71
    Run: https://github.com/AETHERXGLOBAL/execsurface/actions/runs/36301162578

    Results:

    • casey/just: 3/3 persistent invocations PASS, 6/6 sessions PASS; artifact 10926175328, digest sha256:9de1bd5dd4b005b2eec79144277df1616eb29ec3576fd7bad66f3ce74fd64941.
    • junegunn/fzf: 3/3 persistent invocations PASS, 6/6 sessions PASS; artifact 10925861295, digest sha256:3afee45753c3d823a26b3e640fae7b66a720e8fc10b9b96c887b0d55a2c56edd.

    No accepted session had lifecycle leak, stale epoch, routing error, producer drop, decode error, integrity error, event-limit hit, residual membership, or authority-boundary violation.

    The committed M8.7 persistent collector source was unchanged; only a runner-local barrier adapter was used to hand off the pinned real commands after root epoch registration.

    E2 proves lifecycle/health only. Full ptrace semantic parity and performance value remain unestablished. E3 is now authorized to test only shared lifecycle propositions before any performance timing.

  3. aetherxeg-source commented on Sep 27, 2026

    @aetherxeg-source
    ContributorAuthor

    E3 shared lifecycle proposition parity — CLOSED / PASS

    Formal result: docs/milestones/POST_M9_EBPF_E3_SHARED_LIFECYCLE_PARITY_RESULT.md
    Commit: 812ddfaca52bc9a471fc0c8b8239be2bf7394183
    Run: https://github.com/AETHERXGLOBAL/execsurface/actions/runs/36301688725
    Artifact: 10925328847
    Digest: sha256:6709544a4e3023d661c52d0cc81c8e40e66a4d861cf2db627e5115cf7dda9cc2

    Result:

    • ptrace reference/reference proposition determinism PASS;
    • ptrace projection: 2 root-child spawns, success child exactly 2 successful exec occurrences, failed-exec child 0 successful exec occurrences, exit 0;
    • persistent eBPF epoch 1 projection exactly matched ptrace;
    • persistent eBPF epoch 2 projection exactly matched ptrace;
    • each eBPF session had event_count 7 / spawn 2 / exec 2 / exit 3 and passed every M8.7 health gate;
    • BPF source remained unchanged; only transcript-only userspace evidence instrumentation was applied inside the runner and preserved in the artifact.

    Authority remained unchanged: full_surface_comparable=false, ebpf_pass_authorized=false, product_integration_authorized=false.

    E4 same-workload performance requalification is now authorized to be preregistered. Public eBPF authority remains prohibited.

  4. aetherxeg-source commented on Sep 28, 2026

    @aetherxeg-source
    ContributorAuthor

    E4 execution start — development-branch isolation

    Execution is starting from the isolated branch development/post-alpha4-behavioral-integrity at HEAD c70a92694094e28c628f428cc5dd02f9e6064109.

    The E4 scientific protocol is already preregistered in docs/milestones/POST_M9_EBPF_E4_SAME_WORKLOAD_VALUE_PROTOCOL.md and the E4 harness/workflow already exist. No workload, sample count, health gate, threshold, classification rule, authority boundary, or harness semantics will be changed before measurement.

    One execution-plumbing-only change is authorized now: extend the E4 workflow push trigger from main to the isolated development branch so the preregistered experiment executes away from the published alpha.4 line. This trigger change does not modify the experiment itself.

    Frozen E4 rules remain: 3 warmups + 15 measured samples per mode, no outlier removal, no sample replacement, health/completeness before timing acceptance, 10% per-target threshold, and no public eBPF authority regardless of result.

    Published v0.1.0-alpha.4 / stable @v0.1 remain untouched.

  5. aetherxeg-source commented on Sep 28, 2026

    @aetherxeg-source
    ContributorAuthor

    E4 same-workload value requalification — CLOSED / BLOCKED BY INCOMPLETE EVIDENCE

    Formal result committed on the isolated development branch:

    docs/milestones/POST_M9_EBPF_E4_SAME_WORKLOAD_VALUE_RESULT.md

    Commit: 337bc394291844d01496e146c590875b67f3aaf1
    Run: https://github.com/AETHERXGLOBAL/execsurface/actions/runs/36490724891
    Execution source: 3c21521efd7b0f150d3785993916562c908f2f2c

    Both preregistered targets (junegunn/fzf and casey/just) were blocked at ptrace warmup #1 by the existing alpha.4 fail-closed shared_fd_table_ambiguity guard. In both cases the target exited 0, but complete=false, so the protocol correctly refused to admit timing samples.

    No 15-sample measured set was formed. No failed sample was replaced. No rerun was used to seek a cleaner result. The 10% threshold and all health/authority rules remained unchanged.

    Artifacts:

    • FZF: 11001308264, sha256:611038a250936981d478d808c04e748b6389ed13c7602a76b085ab6a19fb69d1
    • JUST: 11001373432, sha256:4c3e64ed009fb29e998a72de43b6881d4f3ded994dd541754f9b0000d0a242dd

    Formal classification: E4_BLOCKED_BY_INCOMPLETE_EVIDENCE.

    Interpretation: this does not establish an eBPF speed win or loss. It establishes that the current completeness contract makes the value comparison inadmissible on these concurrent workloads. The negative result is retained and becomes an input to Semantics v3/shared-FD authority work.

    Authority remains unchanged: ptrace public reference retained; eBPF research-only; no eBPF learn/check/PASS, auto-selection, full-surface comparability, or baseline interchangeability.

    Issue #85 can now close as completed scientific work with a negative/incomplete result. No public alpha.4 change is authorized.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions