You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
feat(chat): context overflow protection — auto-summarize conversation when approaching model context limit #9043
Long conversations silently hit the model's context window limit, causing the model to lose early context, hallucinate, or fail entirely. Users have no warning and no automatic protection. This is especially acute for LLC agents running multi-hour tasks.
Auto-summarize the earliest portion of the conversation history and replace it with a compact summary
'Rolling window' mode: always keep the last N tokens verbatim; summarize everything older
User preference: warn only / auto-summarize / hard stop
For LLC agents: checkpoint before summarization so the original history is preserved
Summary injected as a system message so the model knows context was compressed
AutoBot Fit
autobot-backend/chat_history/ manages session history. New ContextCompressor service: monitors token count, triggers summarization via the LLM gateway when threshold is crossed. Summarization prompt: 'Compress the following conversation segment preserving all decisions, facts, and action items.' LLC heartbeat runs: compress between task steps to stay within context.
Activity
feat(chat): add context overflow integration layer (#9043)
docs(chat): add context overflow protection integration guide (#9043)
feat(chat): context overflow protection — auto-summarize when approac…
test(chat): fix ConversationSummarizer test patching (#9043)
feat(chat): wire context overflow protection into chat endpoints (#9043…
feat(chat): context overflow protection — auto-summarize conversation…
feat(llm): quota-triggered model fallback (GH#8998) (#9442)
mrveiss commentedon Jun 4, 2026
Completed via Paperclip MVA-3107
feat(chat): wire context overflow protection into chat endpoints (#9043…
feat(llm): quota-triggered model fallback (GH#8998) (#9442)
test(chat): update _generate_ai_response contract tests to post-#9043 …
feat(llm): per-request/per-conversation model & provider override in …