Skip to content

Standardize Block Hashing for KVCache Compatibility #96

@sagiahrac

Description

@sagiahrac

To ensure consistent hashing from prompt tokens to block hashes that align with the underlying KVCache index, the block hasher logic must be factored out into a single, shared implementation.

Right now, if each prefix store implements its own block hashing, there’s a risk of divergence. Instead, we should rely on one canonical block hasher (compatible with vLLM’s prefix caching design) so that block boundaries and hash values are uniform across all stores.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions