Skip to content

[Major Change][Undecided yet] Move to FlashDecoding instead of PagedAttention kernel.#1940

Merged
Narsil merged 16 commits intomainfrom flashdecodingJul 1, 2024

Commits

Commits on Jul 1, 2024