Explicit Cache documents with reference ids?

[yupbank]

I have a unique setup with a large document, many user might have questions for it.

Currently, i'm concatenating the document || question as prompt for each request. Which do benefit from prefix cache, but still requires some amount of overhead. i wonder if it's possible to have cache_reference_to_document || question support, so it's more explicit and reduce overheads

[DarkLight1337]

No, this is not supported unless you modify vLLM code