Skip to content

Umbrella: agent-framework-excellence — the substrate LLMs and humans both choose #10542

Closed
12 of 12 issues completed

Description

@mrveiss

Umbrella: agent-framework-excellence

Goal

Make AutoBot the agent substrate that both LLMs and humans prefer to work inside — the most flexible and most powerful framework for human↔AI collaboration, with freedom of model choice for everyone (local, hosted, or subscription).

This umbrella came out of a first-person capability assessment (an LLM judging whether it would want to run inside AutoBot, and what it would still lack). The verdict: AutoBot is already top-tier — real reasoning loop + belief state + stagnation detection, approval gates, a Docker sandbox executor, a full MCP client (stdio/SSE/HTTP) and MCP server, tiered memory + knowledge graph, a 10+ provider LLM gateway with fallback/circuit-breaker/semantic-cache, RLM self-critique, and a shipped human↔agent surface (handoff / assign / review-inbox §6.11, approval inboxes). The gaps below are what separate a great agent platform from the human-AI collaboration framework.

Two themes

A. Collaboration core — make the human↔agent relationship live, trustworthy, and self-improving.
B. Freedom of model choice — first-class Mistral & Claude Code providers + subscription/OAuth auth so we never limit anyone to pay-per-token API keys.

Tasks

A. Collaboration core — the relationship, made live & trustworthy

B. Freedom of model choice — never limit anyone

Principles

  • Reuse existing substrate — every gap below has the hard parts already built; most are "connect the last wire," not greenfield.
  • No model lock-in: local-first, but every hosted/subscription provider is a drop-in via the existing BaseProvider ABC + ProviderRegistry.
  • Each child is one PR, Dev_new_gui-targeted, with file:line entry points in its body.

Activity

  1. mrveiss commented on Jun 28, 2026

    @mrveiss
    OwnerAuthor

    New concrete sub-issues from Ornith-1.0 research (Theme A — closing the loop)

    Comparison against DeepReinforce's Ornith-1.0 (self-scaffolding RL: reward shapes the scaffold, not just the route/solution) surfaced three precise, PR-sized "last wire" gaps — machinery AutoBot already built and left disconnected:

    #10580 and #10581 are concrete sub-slices of #10545 (closed feedback→behavior loop).

  2. mrveiss commented on Jun 28, 2026

    @mrveiss
    OwnerAuthor

    Follow-up from the same research thread — a 4th, eval-side sub-issue:

    Together #10580 + #10581 + #10583 form the in-context (no-weight-training) version of Ornith-1.0's self-scaffolding loop: propose candidate scaffolds → reward-rank → execute → feed reward back. Blueprint paper for #10580/#10581: Experience as a Compass (evolving orchestration + agent prompts, API-compatible).

  3. mrveiss commented on Jul 6, 2026

    @mrveiss
    OwnerAuthor

    Epic complete — all 12 members delivered ✅

    All agent-framework members merged to Dev_new_gui:

    Follow-up security hardening for #10551/#10554/#10544 tracked in PR #10989 (IDOR + CSWSH). Efficiency/precision continuation is umbrella #10603.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions