CVPR 2024 论文和开源项目合集(Papers with Code)

CVPR 2024 decisions are now available on OpenReview！

注1：欢迎各位大佬提交issue，分享CVPR 2024论文和开源项目！

注2：关于往年CV顶会论文以及其他优质CV论文和大盘点，详见： https://github.com/amusi/daily-paper-computer-vision

• CVPR 2019
• CVPR 2020
• CVPR 2021
• CVPR 2022
• CVPR 2023

欢迎扫码加入【CVer学术交流群】，这是最大的计算机视觉AI知识星球！每日更新，第一时间分享最新最前沿的计算机视觉、AI绘画、图像处理、深度学习、自动驾驶、医疗影像和AIGC等方向的学习资料，学起来！

【CVPR 2024 论文开源目录】

• 3DGS
• Avatars
• Backbone
• CLIP
• MAE
• Embodied AI
• GAN
• GNN
• 多模态大语言模型(MLLM)
• NAS
• OCR
• NeRF
• DETR
• Prompt
• Diffusion Models(扩散模型)
• ReID(重识别)
• 长尾分布(Long-Tail)
• Vision Transformer
• 视觉和语言(Vision-Language)
• 自监督学习(Self-supervised Learning)
• 数据增强(Data Augmentation)
• 目标检测(Object Detection)
• 目标跟踪(Visual Tracking)
• 语义分割(Semantic Segmentation)
• 实例分割(Instance Segmentation)
• 全景分割(Panoptic Segmentation)
• 医学图像分割(Medical Image Segmentation)
• 视频目标分割(Video Object Segmentation)
• 视频实例分割(Video Instance Segmentation)
• 参考图像分割(Referring Image Segmentation)
• 图像抠图(Image Matting)
• 图像编辑(Image Editing)
• Low-level Vision
• 超分辨率(Super-Resolution)
• 去噪(Denoising)
• 去模糊(Deblur)
• 3D点云(3D Point Cloud)
• 3D目标检测(3D Object Detection)
• 3D语义分割(3D Semantic Segmentation)
• 3D目标跟踪(3D Object Tracking)
• 3D语义场景补全(3D Semantic Scene Completion)
• 3D配准(3D Registration)
• 3D人体姿态估计(3D Human Pose Estimation)
• 3D人体Mesh估计(3D Human Mesh Estimation)
• 医学图像(Medical Image)
• 图像生成(Image Generation)
• 视频生成(Video Generation)
• 视频理解(Video Understanding)
• 行为检测(Action Detection)
• 文本检测(Text Detection)
• 知识蒸馏(Knowledge Distillation)
• 模型剪枝(Model Pruning)
• 图像压缩(Image Compression)
• 异常检测(Anomaly Detection)
• 三维重建(3D Reconstruction)
• 深度估计(Depth Estimation)
• 轨迹预测(Trajectory Prediction)
• 车道线检测(Lane Detection)
• 图像描述(Image Captioning)
• 视觉问答(Visual Question Answering)
• 手语识别(Sign Language Recognition)
• 视频预测(Video Prediction)
• 新视点合成(Novel View Synthesis)
• Zero-Shot Learning(零样本学习)
• 立体匹配(Stereo Matching)
• 特征匹配(Feature Matching)
• 场景图生成(Scene Graph Generation)
• 隐式神经表示(Implicit Neural Representations)
• 图像质量评价(Image Quality Assessment)
• 数据集(Datasets)
• 新任务(New Tasks)
• 其他(Others)

3DGS

Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering

• Homepage: https://city-super.github.io/scaffold-gs/
• Paper: https://arxiv.org/abs/2312.00109
• Code: https://github.com/city-super/Scaffold-GS

GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis

• Homepage: https://shunyuanzheng.github.io/GPS-Gaussian
• Paper: https://arxiv.org/abs/2312.02155
• Code: https://github.com/ShunyuanZheng/GPS-Gaussian

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians

• Paper: https://arxiv.org/abs/2312.02134
• Code: https://github.com/huliangxiao/GaussianAvatar

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting

• Paper: https://arxiv.org/abs/2311.14521
• Code: https://github.com/buaacyw/GaussianEditor

Avatars

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians

• Paper: https://arxiv.org/abs/2312.02134
• Code: https://github.com/huliangxiao/GaussianAvatar

Backbone

CLIP

MAE

Embodied AI

EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

• Homepage: https://tai-wang.github.io/embodiedscan/

• Paper: https://arxiv.org/abs/2312.16170

• Code: https://github.com/OpenRobotLab/EmbodiedScan

GAN

OCR

An Empirical Study of Scaling Law for OCR

• Paper: https://arxiv.org/abs/2401.00028
• Code: https://github.com/large-ocr-model/large-ocr-model.github.io

NeRF

DETR

DETRs Beat YOLOs on Real-time Object Detection

• Paper: https://arxiv.org/abs/2304.08069
• Code: https://github.com/lyuwenyu/RT-DETR

Prompt

多模态大语言模型(MLLM)

mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration

• Paper: https://arxiv.org/abs/2311.04257

• Code: https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2

NAS

ReID(重识别)

Diffusion Models(扩散模型)

InstanceDiffusion: Instance-level Control for Image Generation

• Homepage: https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/

• Paper: https://arxiv.org/abs/2402.03290

• Code: https://github.com/frank-xwang/InstanceDiffusion

Residual Denoising Diffusion Models

• Paper: https://arxiv.org/abs/2308.13712

• Code: https://github.com/nachifur/RDDM

Vision Transformer

TransNeXt: Robust Foveal Visual Perception for Vision Transformers

• Paper: https://arxiv.org/abs/2311.17132
• Code: https://github.com/DaiShiResearch/TransNeXt

视觉和语言(Vision-Language)

目标检测(Object Detection)

DETRs Beat YOLOs on Real-time Object Detection

• Paper: https://arxiv.org/abs/2304.08069
• Code: https://github.com/lyuwenyu/RT-DETR

目标跟踪(Object Tracking)

语义分割(Semantic Segmentation)

Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic Segmentation

• Paper: https://arxiv.org/abs/2312.04265
• Code: https://github.com/w1oves/Rein

医学图像分割(Medical Image Segmentation)

3D点云(3D-Point-Cloud)

3D目标检测(3D Object Detection)

PTT: Point-Trajectory Transformer for Efficient Temporal 3D Object Detection

• Paper: https://arxiv.org/abs/2312.08371
• Code: https://github.com/kuanchihhuang/PTT

3D语义分割(3D Semantic Segmentation)

图像编辑(Image Editing)

Edit One for All: Interactive Batch Image Editing

• Homepage: https://thaoshibe.github.io/edit-one-for-all
• Paper: https://arxiv.org/abs/2401.10219
• Code: https://github.com/thaoshibe/edit-one-for-all

Low-level Vision

Residual Denoising Diffusion Models

• Paper: https://arxiv.org/abs/2308.13712

• Code: https://github.com/nachifur/RDDM

超分辨率(Video Super-Resolution)

去噪(Denoising)

图像去噪(Image Denoising)

图像生成(Image Generation)

InstanceDiffusion: Instance-level Control for Image Generation

• Homepage: https://people.eecs.berkeley.edu/~xdwang/projects/InstDiff/

• Paper: https://arxiv.org/abs/2402.03290

• Code: https://github.com/frank-xwang/InstanceDiffusion

ECLIPSE: A Resource-Efficient Text-to-Image Prior for Image Generations

• Homepage: https://eclipse-t2i.vercel.app/

• Paper: https://arxiv.org/abs/2312.04655

• Code: https://github.com/eclipse-t2i/eclipse-inference

Instruct-Imagen: Image Generation with Multi-modal Instruction

• Paper: https://arxiv.org/abs/2401.01952

Residual Denoising Diffusion Models

• Paper: https://arxiv.org/abs/2308.13712
• Code: https://github.com/nachifur/RDDM

UniGS: Unified Representation for Image Generation and Segmentation

• Paper: https://arxiv.org/abs/2312.01985

视频生成(Video Generation)

Vlogger: Make Your Dream A Vlog

• Paper: https://arxiv.org/abs/2401.09414
• Code: https://github.com/Vchitect/Vlogger

视频理解(Video Understanding)

其他(Others)

Object Recognition as Next Token Prediction

• Paper: https://arxiv.org/abs/2312.02142
• Code: https://github.com/kaiyuyue/nxtp

ParameterNet: Parameters Are All You Need for Large-scale Visual Pretraining of Mobile Networks

• Paper: https://arxiv.org/abs/2306.14525
• Code: https://parameternet.github.io/

Seamless Human Motion Composition with Blended Positional Encodings

• Paper: https://arxiv.org/abs/2402.15509
• Code: https://github.com/BarqueroGerman/FlowMDM

LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning

• Homepage: https://ll3da.github.io/

• Paper: https://arxiv.org/abs/2311.18651

• Code: https://github.com/Open3DA/LL3DA

CLOVA: A Closed-LOop Visual Assistant with Tool Usage and Update

• Homepage: https://clova-tool.github.io/
• Paper: https://arxiv.org/abs/2312.10908