colpali

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

Vision-Augmented Retrieval and Generation (VARAG) - Vision first RAG Engine

High-Performance Engine for Multi-Vector Search

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

LitePali is a minimal, efficient implementation of ColPali for image retrieval and indexing, optimized for cloud deployment.

🐊 Snappy's unique approach unifies vision-language late interaction with structured OCR for region-level knowledge retrieval. Like the project? Drop a star! ⭐

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

Fused Triton kernels for late-interaction (MaxSim) scoring

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

A monorepo containing various utility scripts, tools, and applications for development, automation, and AI-powered tasks.

The PyQt6 application using ColPali and OpenAI to show Efficient Document Retrieval with Vision Language Models

The repo provides the code for Qdrant for efficient image indexing and retrieval using models such as ColPali, ColQwen, and VDR-2B-Multi-V1, jina embeddings v4 etc enhancing multimodal search capabilities across various applications.

REST API for computing cross-modal similarity between images and text using the ColPaLI vision-language model

Vision-grounded RAG agent for financial documents, built on a self-finetuned ColPali and LangGraph.

Vision-first document RAG for PDF, DOCX, and image QA/extraction with ColQwen2, Qwen2.5-VL, Qdrant, and FastAPI.

Vision-based RAG

Multimodal medical RAG: ColPali visual retrieval + Google Gemini + a Mondo Knowledge Graph, evaluated on the MIRAGE benchmark.

`ragpipe` is a lightweight RAG ingestion pipeline toolkit. It helps you go from documents → chunks → embeddings → vector store export.