Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Complete removal or f16_kv, add offload_kqv field
This addresses two issues: - abetlen#995 which just requests to add the KV cache offloading param - abetlen#1006 a NULL ptr exception when using the embeddings (introduced by leaving f16_kv in the fields struct)
- Loading branch information