New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[MISC] Keep chunked prefill enabled by default with long context when prefix caching is enabled #8342

Merged

comaniac merged 1 commit into vllm-project:main from comaniac:keep_cp_enable

Sep 10, 2024

Merged

[MISC] Keep chunked prefill enabled by default with long context when prefix caching is enabled #8342

remove

Annotations

1 warning

This job succeeded