Code of Conduct
Search before asking
Describe the bug
CompactionMiddleware fires an extra summarizer LLM call when compaction triggers, but the tokens from that call (prompt_tokens / completion_tokens / total_tokens) are never added to the session's accumulated token totals. As a result, token accounting diverges from the LLM provider's actual billing.
Affects Version(s)
master
Kyuubi Server Log Output
Kyuubi Engine Log Output
Kyuubi Server Configurations
Kyuubi Engine Configurations
Additional context
No response
Are you willing to submit PR?
Code of Conduct
Search before asking
Describe the bug
CompactionMiddlewarefires an extra summarizer LLM call when compaction triggers, but the tokens from that call (prompt_tokens/completion_tokens/total_tokens) are never added to the session's accumulated token totals. As a result, token accounting diverges from the LLM provider's actual billing.Affects Version(s)
master
Kyuubi Server Log Output
Kyuubi Engine Log Output
Kyuubi Server Configurations
Kyuubi Engine Configurations
Additional context
No response
Are you willing to submit PR?