Skip to content

Eval: rebuild the graph with #399's extraction and re-measure #414

Description

@antejavor

Part of #390. From the #399 grilling. Depends on #413.

What

Rebuild the eval graph once with the new extraction, then measure:

  • graph quality (graph-quality) against the baseline taken on today's graph;
  • one full-hybrid run on LongMemEval's judge as the no-regression check (today 84–85/100; single-session-assistant 10/11 is the one to watch, since assistant-turn edges shrink).

Acceptance

Both reports, compared with the baselines.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions