MiniCPM-V 4.5: A GPT-4o Level MLLM for Single Image, Multi Image and High-FPS Video Understanding on Your Phone
-
Updated
Sep 24, 2025 - Python
#
multi-modal
Here are 417 public repositories matching this topic...
AgentScope: Agent-Oriented Programming for Building LLM Applications
-
Updated
Oct 3, 2025 - Python
[CVPR 2024 Oral] InternVL Family: A Pioneering Open-Source Alternative to GPT-4o. 接近GPT-4o表现的开源多模态对话模型
image-classification gpt multi-modal semantic-segmentation video-classification image-text-retrieval llm vision-language-model gpt-4v vit-6b vit-22b gpt-4o
-
Updated
Sep 22, 2025 - Python
Database for AI. Store Vectors, Images, Texts, Videos, etc. Use with LLMs/LangChain. Store, query, version, & visualize any AI data. Stream data in real-time to PyTorch/TensorFlow. https://activeloop.ai
python data-science machine-learning ai computer-vision deep-learning tensorflow cv image-processing ml pytorch datasets multi-modal datalake mlops vector-search vector-database large-language-models llm langchain
-
Updated
Oct 10, 2025 - Python
ModelScope: bring the notion of Model-as-a-Service to life.
-
Updated
Oct 10, 2025 - Python
Open-source framework for conversational voice AI agents
-
Updated
Oct 11, 2025 - C
a state-of-the-art-level open visual language model | 多模态预训练模型
-
Updated
May 29, 2024 - Python
AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.
agi multi-model gpt multi-modal ai-agents gemini-api ai-workspace ai-suite gpt-5 perplexity-api anthropic-api deepseek-api xai-api nano-banana openai-responses-api sonnet-4-5
-
Updated
Oct 12, 2025 - TypeScript
Implementation / replication of DALL-E, OpenAI's Text to Image Transformer, in Pytorch
-
Updated
Feb 17, 2024 - Python
Chinese version of CLIP which achieves Chinese cross-modal retrieval and representation generation.
nlp computer-vision deep-learning transformers pytorch chinese pretrained-models multi-modal clip coreml-models contrastive-loss vision-language multi-modal-learning image-text-retrieval vision-and-language-pre-training
-
Updated
Aug 29, 2025 - Jupyter Notebook
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
data-science data data-visualization data-analysis data-processing multi-modal data-pipeline synthetic-data pre-training foundation-models large-language-models llm llms instruction-tuning
-
Updated
Oct 11, 2025 - Python
Open Source Routing Engine for OpenStreetMap
directions openstreetmap routing astar traveling-salesman dijkstra routing-engine isochrones multi-modal tiled
-
Updated
Oct 11, 2025 - C++
Unified embedding generation and search engine. Also available on cloud - cloud.marqo.ai
search-engine machine-learning natural-language-processing information-retrieval deep-learning transformers machinelearning gpt visual-search multi-modal clip knn semantic-search hacktoberfest hnsw vector-search vision-language large-language-models tensor-search chatgpt
-
Updated
Oct 11, 2025 - Python
OmniGen: Unified Image Generation. https://arxiv.org/pdf/2409.11340
-
Updated
Jun 15, 2025 - Jupyter Notebook
Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型
-
Updated
Aug 23, 2024 - Python
[EMNLP 2022] An Open Toolkit for Knowledge Graph Extraction and Construction
nlp deep-learning prompt pytorch information-extraction knowledge-graph named-entity-recognition chinese ner multi-modal kg relation-extraction lightner few-shot low-resource document-level attribute-extraction knowprompt deepke instructie
-
Updated
Jul 19, 2025 - Python
【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection
-
Updated
Dec 3, 2024 - Python
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
computer-vision evaluation pytorch gemini openai vqa vit gpt multi-modal clip claude openai-api gpt4 large-language-models llm chatgpt llava qwen gpt-4v
-
Updated
Oct 11, 2025 - Python
Represent, send, store and search multimodal data
elasticsearch machine-learning deep-learning protobuf pytorch data-structures nearest-neighbor-search cross-modal multi-modal semantic-search multimodal nested-data weaviate dataclass pydantic fastapi neural-search qdrant docarray
-
Updated
Jun 17, 2025 - Python
Improve this page
Add a description, image, and links to the multi-modal topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multi-modal topic, visit your repo's landing page and select "manage topics."