[Major Change][Undecided yet] Move to FlashDecoding instead of PagedAttention kernel.#1940
Merged
Narsil merged 16 commits intomainfrom flashdecodingJul 1, 2024
+222-74
Commits
Commits on Jul 1, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed