transformer-optimization

Here is 1 public repository matching this topic...

VARUN3WARE / Paged-Attention

Implementation of PagedAttention from vLLM paper - a breakthrough attention algorithm that treats KV cache like virtual memory. Eliminates memory fragmentation, increases batch sizes, and dramatically improves LLM serving throughput.

memory-optimization kv-cache llm-inference paged-attention transformer-optimization

Updated Dec 3, 2025
Python

Improve this page

Add a description, image, and links to the transformer-optimization topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the transformer-optimization topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

transformer-optimization

Here is 1 public repository matching this topic...

VARUN3WARE / Paged-Attention

Improve this page

Add this topic to your repo