colpali

Open-source multimodal retrieval engine (Morphik Core). By Morphik — AI back office for skilled nursing & senior living (morphik.ai).

The code used to train and run inference with the ColVision models, e.g. ColPali, ColQwen2, and ColSmol.

LAYRA—an enterprise-ready, out-of-the-box solution—unlocks next-generation intelligent systems powered by visual RAG and limitless visual multi-step agent workflow orchestration.

Use late-interaction multi-modal models such as ColPali in just a few lines of code.

Vision-Augmented Retrieval and Generation (VARAG) - Vision first RAG Engine

Serverless Modal + FastAPI + React + ColPali + Qdrant + GPT4o Vision RAG (V-RAG) Demo

Recipes for learning, fine-tuning, and adapting ColPali to your multimodal RAG use cases. 👨🏻‍🍳

High-Performance Engine for Multi-Vector Search

Vision Document Retrieval (ViDoRe): Benchmark. Evaluation code for the ColPali paper.

LitePali is a minimal, efficient implementation of ColPali for image retrieval and indexing, optimized for cloud deployment.

🐊 Snappy's unique approach unifies vision-language late interaction with structured OCR for region-level knowledge retrieval. Like the project? Drop a star! ⭐

Production inference for encoder models - ColBERT, GLiNER, ColPali, embeddings etc. - as vLLM plugins for online and in-process deployment

Pixel-native visual RAG ported to Rust on the ruvector ANN substrate (HNSW + IVF-Flat) — screenshot/document retrieval over visual embeddings, a Rust port of PixelRAG, with a metaharness benchmark CLI: npx rupixel

A new novel multi-modality (Vision) RAG architecture

Fused Triton kernels for late-interaction (MaxSim) scoring

High-performance late-interaction retrieval engine for on-prem AI. ColBERT/ColPali multi-vector search with Rust fused MaxSim, Triton GPU kernels, ROQ quantization, LEMUR routing, WAL-backed CRUD, and a FastAPI server — single machine, CPU or GPU.

Cloud-agnostic Agentic AI & Multi-Modal RAG platform with GraphRAG, intelligent routing, MCP enterprise integrations (Odoo, PostgreSQL), and pluggable LLM providers.

A monorepo containing various utility scripts, tools, and applications for development, automation, and AI-powered tasks.

#3 Winner of Best Use of Zoom API at Stanford TreeHacks 2025! An AI-powered meeting assistant that captures video, audio and textual context from Zoom calls using multimodal RAG.

The PyQt6 application using ColPali and OpenAI to show Efficient Document Retrieval with Vision Language Models