Prefix-Aware Attention for LLM Decoding
-
Updated
Mar 31, 2026 - Python
#
vllm-plugins
Here are 6 public repositories matching this topic...
Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment
retrieval encoder inference embeddings ner serving rag colbert ml-infra-deployments vllm gliner multimodal-rag ai-infrastructure colpali triton-kernels vllm-plugins
-
Updated
Apr 10, 2026 - Python
A curated list of plugins built on top of vLLM
-
Updated
Dec 12, 2025
FlashHead: Efficient Drop-In Replacement for the Classification Head in Language Model Inference
-
Updated
Apr 10, 2026 - Python
A manager to load vllm plugins without rebuilding image for each new plugin.
-
Updated
Jan 10, 2026 - Python
vLLM Plugins for additional features like decoding strategies, monitoring, models etc
-
Updated
Dec 24, 2025 - Python
Improve this page
Add a description, image, and links to the vllm-plugins topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vllm-plugins topic, visit your repo's landing page and select "manage topics."