[Performance] Enable chunked prefill and prefix caching together (#8120) · triple-Mu/vllm_official@f8f2ed0 · GitHub

Commit

[Performance] Enable chunked prefill and prefix caching together (vll…

Browse files

…m-project#8120)

Co-authored-by: Tao He <sighingnow@gmail.com>
Co-authored-by: Juelianqvq <Juelianqvq@noreply.github.com>

Loading branch information

3 people authored and triple-Mu committed Sep 4, 2024

1 parent 682334b commit f8f2ed0