Skip to content

M29: large tool response offload to filesystem #791

@bug-ops

Description

@bug-ops

Offload large tool responses to temp files instead of keeping in context or zeroing out.

Gap: Zeph has no offload mechanism — large outputs stay in context or get body-zeroed losing information. Responses exceeding a threshold should be written to temp files with a pointer retained in context.

Acceptance Criteria

  • Implement response offload with configurable threshold
  • Add config.toml options for offload threshold and retention
  • Implement cleanup for expired offload files

Ref: .local/plan/m27-m31-context-memory-improvements.md

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions