Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
simple : update error message for KV cache check (#4324)
This commit updates the error message that is printed when the KV cache is not big enough to hold all the prompt and generated tokens. Specifically it removes the reference to n_parallel and replaces it with n_len. Signed-off-by: Daniel Bevenius <daniel.bevenius@gmail.com>
- Loading branch information