[ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding

This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.

Codebase for Aria - an Open Multimodal Native MoE

Make huge neural nets fit in memory

A paper list of some recent works about Token Compress for Vit and VLM

Official repo for "Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models"

g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains

Personal Project: MPP-Qwen14B & MPP-Qwen-Next(Multimodal Pipeline Parallel based on Qwen-LM). Support [video/image/multi-image] {sft/conversations}. Don't let the poverty limit your imagination! Tr…

Official inference repo for FLUX.1 models

Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

High-resolution models for human tasks.

Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.

Repository for Meta Chameleon, a mixed-modal early-fusion foundation model from FAIR.

LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer

Controllable video and image Generation, SVD, Animate Anyone, ControlNet, ControlNeXt, LoRA

LLMs build upon Evol Insturct: WizardLM, WizardCoder, WizardMath

The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use th…

llama3 implementation one matrix multiplication at a time

Diffree: Text-Guided Shape Free Object Inpainting with Diffusion Model

Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models

ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generation (ICCV 2023, Oral)

AIGC-interview/CV-interview/LLMs-interview面试问题与答案集合仓，同时包含工作和科研过程中的新想法、新问题、新资源与新项目

The image prompt adapter is designed to enable a pretrained text-to-image diffusion model to generate images with image prompt.

InstantID: Zero-shot Identity-Preserving Generation in Seconds 🔥

[TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"