Skip to content

The model supports 1M context, but why does the tool only trigger context compression at 128K #5239

Description

@hardy922

Description

The model supports 1M context, but why does the tool only trigger context compression at 128K

Image

,Can it be set to support 1M context instead of frequently triggering compression

Image
  • OS: window
  • codewhale version: v0.9.3
  • Install method:
  • codewhale doctor summary:
  • Model/provider:
  • Terminal app:
  • Shell:

Logs, screenshots, or recordings

Maintainer diagnosis and v0.9.7 acceptance

This report is the canonical user-facing tracker for the residual unknown-model class previously described in #5244.

The observed route is a privately deployed custom model whose deployment advertises a 1M context window. Unknown ids currently fall back silently to the legacy 128K window, so auto-compaction can be internally consistent while still being wrong for the configured route.

  • Unknown-model fallback is explicit in model-switch/status/compaction UI and diagnostics; it never looks like a verified 128K capability.
  • The existing providers.<name>.context_window override is discoverable, validated, persisted, and shown as the active source.
  • Provider/catalog model ids and their context windows are data, not scattered hard-coded branches.
  • Switching models/providers re-resolves the window source and pressure thresholds immediately.
  • Tests cover an unknown private id with a 1M override, a known 1M route, and an unknown route with no override.
  • Rebuilt-binary follow-up confirms both the visible meter and compaction trigger use the same resolved window.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcompactionContext management / compactioncontextContext management / contextquestionFurther information is requestedreliabilityReliability, flaky behavior, retries, fallbacks, and robustness

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions