Skip to content

fix(cache): unbreak rotating-cache chunked prefill and default the CLI prefill to chunked - #679

Merged
inureyes merged 2 commits into
mainfrom
fix/678-chunked-prefill-rotating-cache
Jul 6, 2026
Merged

inureyes merged 2 commits into
mainfrom
fix/678-chunked-prefill-rotating-cache

feat(generate): default the single-sequence prefill to chunked 2048 w…

71cceea
Select commit
Loading
Failed to load commit list.