Website:https://cvpr2022.thecvf.com/
Image Animation
- Thin-Plate Spline Motion Model for Image Animation
- Character Animation
- 3D character animation(3D Character Animation)
- 3D Dance Generation
- Learning Motion-Dependent Appearance for High-Fidelity Rendering of Dynamic Humans from a Single Camera
- IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Images
😮oral🏠project - SqueezeNeRF: Further factorized FastNeRF for memory-efficient inference
- Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction
⭐code - Modeling Indirect Illumination for Inverse Rendering
⭐code🏠project - GenDR: A Generalized Differentiable Renderer
⭐code - CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields
⭐code🏠project - NeRF-Editing: Geometry Editing of Neural Radiance Fields
- Sound Source localization
- NPBG++: Accelerating Neural Point-Based Graphics
🏠project - AutoRF: Learning 3D Object Radiance Fields from Single View Observations
🏠project - NeurMiPs: Neural Mixture of Planar Experts for View Synthesis
⭐code🏠project📺video📰here
- ObjectFolder 2.0: A Multisensory Object Dataset for Sim2Real Transfer
⭐code🏠project📰here - Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities
- 3MASSIV: Multilingual, Multimodal and Multi-Aspect dataset of Social Media Short Videos
- Hephaestus: A large scale multitask dataset towards InSAR understanding
- SmartPortraits: Depth Powered Handheld Smartphone Dataset of Human Portraits for State Estimation, Reconstruction and Synthesis
🌻dataset - AKB-48: A Real-World Articulated Object Knowledge Base
⭐code
📰here - Primitive3D: 3D Object Dataset Synthesis from Randomly Assembled Primitives
- Satellite Dataset
- Animal Behavior Understanding Dataset
- Motron: Multimodal Probabilistic Human Motion Forecasting
- Progressively Generating Better Initial Guesses Towards Next Stages for High-Quality Human Motion Prediction
- Light Field
- Deep Reconstruction
- Shutter Correction
- Thermal Infrared Imaging
- Catching Both Gray and Black Swans: Open-set Supervised Anomaly Detection
⭐code - Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection
⭐code
- TransGeo: Transformer Is All You Need for Cross-view Image Geo-localization
⭐code - Visual Geolocation
- Trajectory reconstruction
- Multi-View Transformer for 3D Visual Grounding
⭐code - Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning
⭐code
Visual Positioning,Target location through natural language (very interesting research)
- Few-Shot
- Zero Sample
- Domain Generalization
- Compound Domain Generalization via Meta-Knowledge Encoding
- Causality Inspired Representation Learning for Domain Generalization
- Towards Unsupervised Domain Generalization
Task(domain generalization(DG)),unsupervised learning, unsupervised domain generalization(UDG)。 - out-of-domain generalization
- Domain Adaptation
- HL-Net: Heterophily Learning Network for Scene Graph Generatio
⭐code
Heterogeneous Learning Network
📰here - RU-Net: Regularized Unrolling Network for Scene Graph Generation
⭐code
Regular expansion network
📰here
- CD2-pFed: Cyclic Distillation-guided Channel Decoupling for Model Personalization in Federated Learning
- Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage
⭐code - FedCorr: Multi-Stage Federated Learning for Label Noise Correction
⭐code - Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning
- Controllable Dynamic Multi-Task Architectures
- Task Adaptive Parameter Sharing for Multi-Task Learning
👉🏼 You can learn about Multi-Task Learning trough my course: https://courses.thinkautonomous.ai/hydranets
- incremental learning
- Class incremental learning
- Give Me Your Attention: Dot-Product Attention Considered Harmful for Adversarial Patch Robustness
- Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Network
- Towards Practical Certifiable Patch Defense with Vision Transformer
📰here - Adversarial example
- Against Attack
- Black Box
- Adversarial Training
- On Generalizing Beyond Domains in Cross-Domain Continual Learning
- Probing Representation Forgetting in Supervised and Unsupervised Continual Learning
- Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundaries
⭐code
- What Matters For Meta-Learning Vision Regression Tasks?
- Multidimensional Belief Quantification for Label-Efficient Meta-Learning
- Selective-Supervised Contrastive Learning with Noisy Labels
⭐code📰here - Frame-wise Action Representations for Long Videos via Sequence Contrastive Learning
⭐code - Cam-Ready: UNICON: Combating Label Noise Through Uniform Selection and Contrastive Learning
- Use All The Labels: A Hierarchical Multi-Label Contrastive Learning Framework
⭐code - Crafting Better Contrastive Views for Siamese Representation Learning
😮oral⭐code
- CRAFT: Cross-Attentional Flow Transformer for Robust Optical Flow
⭐code - DIP: Deep Inverse Patchmatch for High-Resolution Optical Flow
- Imposing Consistency for Optical Flow Estimation
- Deep Equilibrium Optical Flow Estimation
⭐code📰解读 - GMFlow: Learning Optical Flow via Global Matching
😮oral⭐code📰here
👉🏼 You can learn about Optical Flow through: https://courses.thinkautonomous.ai/optical-flow
- Scene Text Detection
- Towards End-to-End Unified Scene Text Detection and Layout Analysis
⭐code - Pushing the Performance Limit of Scene Text Recognizer without Human Annotation
- Vision-Language Pre-Training for Boosting Scene Text Detectors
Visual language pre-training, scene text detection, the code will be open source, the address has not been announced。
- Towards End-to-End Unified Scene Text Detection and Layout Analysis
- Text Spotting
- LOGO设计
- Font Generation
- Text Recognition
- Table structure recognition
- Knowledge Distillation
- Model Compression
- Model Pruning
👉🏼 You can learn about this entire category through: https://courses.thinkautonomous.ai/neural-optimization
- HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interaction
- MSTR: Multi-Scale Transformer for End-to-End Human-Object Interaction Detection
- GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection
⭐code - OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interaction
⭐code
📰here - D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions
🏠code - What to look at and where: Semantic and Spatial Refined Transformer for detecting human-object interactions
😮oral - Human-Object Interaction Detection via Disentangled Transformer
- Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection
⭐code📰here - Interactiveness Field in Human-Object Interactions
⭐code - Stability-driven Contact Reconstruction From Monocular Color Images
⭐code
Reconstruction of Hand-Object Interaction through monocular images, - Interactiveness Field of Human-Object Interactions
⭐code
📰here - Tracking
- 🐦️AlignMix: Improving representation by interpolating aligned features
- 3D Common Corruptions and Data Augmentation
⭐code🏠project📺video📰here - Kubric: A scalable dataset generator
- Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationships
- VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers
- Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
🌻dataset - Robust Cross-Modal Representation Learning with Progressive Self-Distillation
- Prompt Distribution Learning
。 - Vision-Language Pre-Training with Triple Contrastive Learning
⭐code - VLN
- VQA
- AVQA
- Video-QA
- Target Navigation
- try-on
- AR
- Robotics
- Hand-Object Pose Estimation
- Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer
⭐code - Industrial Style Transfer with Large-scale Geometric Warping and Content Preservation
⭐code - Movement Style Transfer
- Movement Transfer
- Scene Stylization
- OSOP: A Multi-Stage One Shot Object Pose Estimation Framework
- OnePose: One-Shot Object Pose Estimation without CAD Models
⭐code🏠project📰paper - 4D
- 9D
- Monocular Object Pose Estimation
- 6D
- RNNPose: Recurrent 6-DoF Object Pose Refinement with Robust Correspondence Field Estimation and Pose Optimization
- FS6D: Few-Shot 6D Pose Estimation of Novel Objects
⭐code🏠project📰here - Uni6D: A Unified CNN Framework without Projection Breakdown for 6D Pose Estimation
- ES6D: A Computation Efficient and Symmetry-Aware 6D Pose Regression Framework
⭐code - Focal Length and Object Pose Estimation via Render and Compare
⭐code🏠project📰paper - DGECN: A Depth-Guided Edge Convolutional Network for End-to-End 6D Pose Estimation
⭐code🏠project📰here - Coupled Iterative Refinement for 6D Multi-Object Pose Estimation
⭐code📰here
- 3D Object Articulation
- 3Dope
- GNN
- Fine-Grained Classification
- Image Classification
- Few-Shot Classification
- CAD: Co-Adapting Discriminative Features for Improved Few-Shot Classification
- Matching Feature Sets for Few-Shot Image Classification
⭐code🏠project📺video - Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification
😮oral⭐code🏠project📰here - Learning to Affiliate: Mutual Centralized Learning for Few-shot Classification
📰here - Generating Representative Samples for Few-Shot Classification
⭐code
📰here
SOTA。 - Few-Shot Classification & Segmentation(FS-CS)
- Long Tail Recognition
- Fine-Grained Identification
- Learning Graph Regularisation for Guided Super-Resolution
- Self-Supervised Super-Resolution for Multi-Exposure Push-Frame Satellites
⭐code🏠project📰here - Deep Constrained Least Squares for Blind Image Super-Resolution
⭐code📰here
- Sketching without Worrying: Noise-Tolerant Sketch-Based Image Retrieval
⭐code - Correlation Verification for Image Retrieval
😮oral⭐code - Sketch3T: Test-Time Training for Zero-Shot SBIR
- Beyond Cross-view Image Retrieval: Highly Accurate Vehicle Localization Using Satellite Image
- Text-Video Retrieval
- Cross-Modal Search
- Interactive Image Synthesis with Panoptic Layout Generation
- Autoregressive Image Generation using Residual Quantization
⭐code📰here - GIRAFFE HD: A High-Resolution 3D-aware Generative Model
- Arbitrary-Scale Image Synthesis
⭐code📰here - Multi-View Consistent Generative Adversarial Networks for 3D-aware Image Synthesis
⭐code📰here - Learning to Memorize Feature Hallucination for One-Shot Image Generation
📰here - Text-Guided Image processing
- Pose-Guided Image Synthesis
- Text-To-Image Synthesis
- Image Translation
- Image Generation
- Remote Sensing Image Fusion
- Aerial Image Segmentation
- Autopilot
- Lane Line Detection
- Lane Line Description
- Behavior Predictioj
- Autopilot Scene Relighting
👉🏼 You can learn about Autonomous Vehicles trough my course: https://courses.thinkautonomous.ai/self-driving-cars
- 🐦️ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Prior
- Arch-Graph: Acyclic Architecture Relation Predictor for Task-Transferable Neural Architecture Search
⭐code📰解读 - GPUNet: Searching the Deployable Convolution Neural Networks for GPUs
(Efficient Net)
- Reid
- Part-based Pseudo Label Refinement for Unsupervised Person Re-identification
⭐code - Camera-Conditioned Stable Feature Generation for Isolated Camera Supervised Person Re-IDentification
- Large-Scale Pre-training for Person Re-identification with Noisy Labels
⭐code - Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-Identification
⭐code - Implicit Sample Extension for Unsupervised Person Re-Identification
⭐code📰here - Graph Sampling Based Deep Metric Learning for Generalizable Person Re-Identification
⭐code - NFormer: Robust Person Re-identification with Neighbor Transformer
⭐code📰here - Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identification
- Dress-up Pedestrian Re-identification
- Occlusion Pedestrian Re-ID
- Part-based Pseudo Label Refinement for Unsupervised Person Re-identification
- Crowd Counting
- Pedestrian Detection
- Gait Recognition
- Person Search
- Temporal Context Matters: Enhancing Single Image Prediction with Disease Progression Representations
- BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotation
- DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slides
- DiRA: Discriminative, Restorative, and Adversarial Learning for Self-supervised Medical Image Analysis
⭐code📰paper - Surpassing the Human Accuracy: Detecting Gallbladder Cancer from USG Images with Curriculum Learning
⭐code🏠project - 3D Bio Printing
- SR(MRI)
- Medical Image Registration
- Medical Image Analysis
- Self-Supervised
- Semi-Supervised
- Weakly Supervised
- Fast Point Transformer
- ChiTransformer:Towards Reliable Stereo from Cues
- Beyond Fixation: Dynamic Window Visual Transformer
- Training-free Transformer Architecture Search
📰here - Automated Progressive Learning for Efficient Training of Vision Transformers
⭐code - Collaborative Transformers for Grounded Situation Recognition
⭐code - TubeDETR: Spatio-Temporal Video Grounding with Transformers
😮oral⭐code🏠project - Deformable Video Transformer
- MixFormer: Mixing Features across Windows and Dimensions
😮oral⭐code📰here - Are Multimodal Transformers Robust to Missing Modality?
- MiniViT: Compressing Vision Transformers with Weight Multiplexing
- Multimodal Token Fusion for Vision Transformers
- Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformer
😮oral⭐code📰here - UTC: A Unified Transformer with Inter-Task Contrastive Learning for Visual Dialog
Transformer - Patch Slimming for Efficient Vision Transformers
📰here - Swin Transformer V2: Scaling Up Capacity and Resolution
⭐code
📰Swin Transformer v2.0 - SimMIM: A Simple Framework for Masked Image Modeling
⭐code - NomMer: Nominate Synergistic Context in Vision Transformer for Visual Recognition
⭐code
📰here - Mobile-Former: Bridging MobileNet and Transformer
- MulT: An End-to-End Multitask Learning Transformer
- Shape Completion
- Stochastic Backpropagation: A Memory Efficient Strategy for Training Video Models
😮oral - Action Segmentation
- Action Understanding
- Video Copy Detection
- Video Synthesis
- Video Anomaly Detection
- Video Surveillance
- Video Moment Retrieval & Highlight Detection
- Video Moment Retrieval
- Video POrediction
- Video Individual Count
- Frame Interpolation
- Many-to-many Splatting for Efficient Video Frame Interpolation
⭐code - TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolation
- Long-term Video Frame Interpolation via Feature Propagation
- Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusion
- Many-to-many Splatting for Efficient Video Frame Interpolation
- Visual Correspondence
- Video Recognition
- Video Classification
- Video Prediction
- Hand Motion Prediction
- Video Segmentation
- Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation
⭐code - VOS
- Video Instance Segmentation(VIS)
- Video Semantic Segmentation
- Video Panorama Segmentation
- Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation
- Video Image Processing
- Super Resolution
- Reference-based Video Super-Resolution Using Multi-Camera Video Triplets
- Learning Trajectory-Aware Transformer for Video Super-Resolution
😮oral⭐code - Investigating Tradeoffs in Real-World Video Super-Resolution
⭐code📰here - BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignment
⭐code🏠project📺video
🏆NTIRE 2021 - Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modeling
📰ETDM - Memory-Augmented Non-Local Attention for Video Super-Resolution
📰here
- Video Recovery
- Video Repair
- Video to Moiré
- Deblur
- Denoising
- Movie Restoration
- Super Resolution
- Representation Learning (Video)
- TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition
😮oral⭐code📰here - Self-Supervised Representation Learning
- Video Comparison Learning
- TransRank: Self-supervised Video Representation Learning via Ranking-based Transformation Recognition
- Video Decomposition
- Shadow Detection
- Frame Interpolation
- VSS
- VSR
- Video Reconstruction
- 🐦️HyperInverter: Improving StyleGAN Inversion via Hypernetwork
🏠project - InsetGAN for Full-Body Image Generation
🏠project
📰1024x1024 Inset GAN - Commonality in Natural Images Rescues GANs: Pretraining GANs with Generic and Privacy-free Synthetic Data
⭐code - Deep Image-based Illumination Harmonization
- GAN-Supervised Dense Visual Alignment
😮oral⭐code🏠project📺video
📰CVPR2022 Oral:GAN - HairMapper: Removing Hair from Portraits Using GANs
⭐code - Image Tampering Detection
- Hair Editing
- Exploring Patch-wise Semantic Relation for Contrastive Learning in Image-to-Image Translation Tasks
- Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation
- InstaFormer: Instance-Aware Image-to-Image Translation with Transformer
- Unsupervised Image-to-Image Translation with Generative Prior
⭐code🏠project📺video
- Protecting Celebrities with Identity Consistency Transformer
- Deepfake
- Makeup Migration
- Face Recognition
- Facial Expression Recognition
- 3D Face Modeling
- Liveness Detection
- DeepFake Detection
- Face Swap
- Face Attribute Classification
- Face Relighting
- Face Editing
- Face Illusion
- Deepfake
- Face Reconstruction
- Face Capture
- Change Head
- Portrait Distortion Correction
- 3D Face Modeling
- Face Repair
- Disentangled3D: Learning a 3D Generative Model with Disentangled Geometry and Appearance from Monocular Images
- Depth-Guided Sparse Structure-from-Motion for Movies and TV Shows
⭐code - 3D-SPS: Single-Stage 3D Visual Grounding via Referred Point Progressive Selection
😮oral⭐code📰here - Stereo Merging
- PSMNet: Position-aware Stereo Merging Network for Room Layout Estimation
- GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Feature
⭐code - Degradation-agnostic Correspondence from Resolution-asymmetric Stereo
- Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlation
😮oral⭐code📰here
- Depth Estimation
- OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusion
- NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimation
- 🐦️Toward Practical Self-Supervised Monocular Indoor Depth Estimation
- P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior
⭐code - HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Model
- Multi-Frame Self-Supervised Depth with Transformers
- Room Layout
- MVS
- 3D Reconstruction
- PlaneMVS: 3D Plane Reconstruction from Multi-View Stereo
- Self-supervised Neural Articulated Shape and Appearance Models
🏠project - BNV-Fusion: Dense 3D Reconstruction using Bi-level Neural Volume Fusion
- Topologically-Aware Deformation Fields for Single-View 3D Reconstruction
⭐code🏠project - Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstruction
⭐code🏠project📰here - What's in your hands? 3D Reconstruction of Generic Objects in Hands
⭐code🏠project📺video📰here - Surface Reconstruction from Point Clouds by Learning Predictive Context Priors
⭐code - FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstruction
⭐code
📰here - 3D Scene Reconstruction
- Hand Reconstruction
- 3D Garment Mesh Reconstruction
- 3D Shape Reconstruction
- 3D Garment Deformation
- Texture Migration & Compositing
- Shape Matching
👉🏼 You can learn about Stereo & 3D Vision here: https://courses.thinkautonomous.ai/stereo-vision
- COAP: Compositional Articulated Occupancy of People
⭐code🏠project📺video📰here - Context-Aware Sequence Alignment using 4D Skeletal Augmentation
😮oral⭐code🏠project - Multi-Person Pose Estimation
- Video-Based HPE
- 3D pose
- MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Video
- PoseTriplet: Co-evolving 3D Human Pose Estimation, Imitation, and Hallucination under Self-supervision
😮oral⭐code - Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation
- Distribution-Aware Single-Stage Models for Multi-Person 3D Pose Estimation
📰here
- 4D Human Capture
- Gesture Generation
- 3D Hand Grid Estimation
- 3D Shape Generation
- Motion Capture
- Arm-Hand Dynamic Estimation
- 3D Hand reconstruction
- 3D Body Shape
- Dense correspondence
- 3D body movement reconstruction
- 3D Human Pose Reconstruction
- Motion Detection
- Colar: Effective and Efficient Online Action Detection by Consulting Exemplars
- Learnable Irrelevant Modality Dropout for Multimodal Action Recognition on Modality-Specific Annotated Videos
- End-to-End Semi-Supervised Learning for Video Action Detection
- SPAct: Self-supervised Privacy Preservation for Action Recognition
⭐code - Temporal Alignment Networks for Long-term Video
😮oral⭐code🏠project📰paper - SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognition
- Zero-Shot Action Recognition
- Few-Shot Action Recognition
- Sequence Action Detection
- Timing action positioning
- Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation
⭐code📰here - Unsupervised Pre-training for Temporal Action Localization Tasks
⭐code - ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization
⭐code - Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localization
⭐code - Structured Attention Composition for Temporal Action Localization
⭐code
- Weakly Supervised Temporal Action Localization via Representative Snippet Knowledge Propagation
- Repetitive Action Count
- Group Action Recognition
- Action Quality Assessment
- Shape-invariant 3D Adversarial Point Clouds
⭐code - AziNorm: Exploiting the Radial Symmetry of Point Cloud for Azimuth-Normalized 3D Perception
- REGTR: End-to-end Point Cloud Correspondences with Transformers
⭐code - Equivariant Point Cloud Analysis via Learning Orientations for Message Passing
⭐code - Text2Pos: Text-to-Point-Cloud Cross-Modal Localization
- Deformation and Correspondence Aware Unsupervised Synthetic-to-Real Scene Flow Estimation for Point Clouds
⭐code - Self-Supervised Arbitrary-Scale Point Clouds Upsampling via Implicit Neural Representation
⭐code📰paper - 3DeformRS: Certifying Spatial Deformations on Point Clouds
⭐code - Reconstructing Surfaces for Sparse Point Clouds with On-Surface Priors
⭐code📰paper - Density-preserving Deep Point Cloud Compression
⭐code🏠project📰paper - Surface Representation for Point Clouds
😮oral⭐code
📰paper - 3D 点云
- CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding
⭐code📰paper
CrossPoint,3D... - A Unified Query-based Paradigm for Point Cloud Understanding
- WarpingGAN: Warping Multiple Uniform Priors for Adversarial 3D Point Cloud Generation
⭐code - 3D Point Cloud Segmentation
- CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding
- Point Cloud Classification
- Point Cloud Registration
- Point Cloud Completion
- Point Cloud Segmentation
- Scene Flow Estimation
👉🏼 You can learn more about point clouds through my intro-course https://courses.thinkautonomous.ai/point-clouds
- TCTrack: Temporal Contexts for Aerial Tracking
⭐code📰paper - Correlation-Aware Deep Tracking
- Global Tracking Transformers
⭐code - Unified Transformer Tracker for Object Tracking
⭐code - Global Tracking via Ensemble of Local Trackers
- Unsupervised Learning of Accurate Siamese Tracking
⭐code - Transformer Tracking with Cyclic Shifting Window Attention
⭐code
Transformer, UAV123, LaSOT, TrackingNet, GOT-10k SOTA. - 3D Target Tracking
- Multi-Target Tracking
- RGB-Tracking
- Visual Tracking
👉🏼 Learn more about object tracking though my course https://courses.thinkautonomous.ai/obstacle-tracking
- DN-DETR: Accelerate DETR Training by Introducing Query DeNoising
⭐code📰paper - Overcoming Catastrophic Forgetting in Incremental Object Detection via Elastic Response Distillation
⭐code - Beyond Bounding Box: Multimodal Knowledge Learning for Object Detection
。 - Dynamic Sparse R-CNN
- Unknown-Aware Object Detection: Learning What You Don't Know from Videos in the Wild
⭐code📰paper - Focal and Global Knowledge Distillation for Detectors
⭐code📰paper - Group R-CNN for Weakly Semi-supervised Object Detection with Points
⭐code
📰paper - Real-time Object Detection for Streaming Perception
⭐code📰paper - Ev-TTA: Test-Time Adaptation for Event-Based Object Recognition
- Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Model
⭐code - Optimal Correction Cost for Object Detection Evaluation
- Expanding Low-Density Latent Regions for Open-Set Object Detection
⭐code
📰paper - SIOD: Single Instance Annotated Per Category Per Image for Object Detection
📰paper - Task-specific Inconsistency Alignment for Domain Adaptive Object Detection
⭐code - Zero-Query Transfer Attacks on Context-Aware Object Detectors
- AdaMixer: A Fast-Converging Query-Based Object Detector
😮oral⭐code - Learning to Detect Mobile Objects from LiDAR Scans Without Labels
⭐code - Forecasting from LiDAR via Future Object Detection
⭐code - Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection
😮oral - Multi-Granularity Alignment Domain Adaptation for Object Detection
- Proper Reuse of Image Classification Features Improves Object Detection
⭐code - R(Det)^2: Randomized Decision Routing for Object Detection
- Towards Robust Adaptive Object Detection under Noisy Annotations
⭐code - Entropy-based Active Learning for Object Detection with Progressive Diversity Constraint
- Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection
- Interactive Segmentation and Visualization for Tiny Objects in Multi-megapixel Images
⭐code - Cross Domain Object Detection by Target-Perceived Dual Branch Distillation
⭐code - Progressive End-to-End Object Detection in Crowded Scenes
⭐code
📰paper - HCSC: Hierarchical Contrastive Selective Coding
⭐code
📰SOTA:上交、Mila - Recurrent Glimpse-based Decoder for Detection with Transformer
😮oral⭐code
📰paper - Few-Shot Target Detection
- 目标定位
- 3D Object Detection
- A Versatile Multi-View Framework for LiDAR-based 3D Object Detection with Guidance from Panoptic Segmentation
- Pseudo-Stereo for Monocular 3D Object Detection in Autonomous Driving
⭐code📰paper - Rope3D: TheRoadside Perception Dataset for Autonomous Driving and Monocular 3D Object Detection Task
🏠project - Point2Seq: Detecting 3D Objects as Sequences
⭐code - MonoDETR: Depth-aware Transformer for Monocular 3D Object Detection
⭐code - LiDAR Snowfall Simulation for Robust 3D Object Detection
😮oral⭐code - CAT-Det: Contrastively Augmented Transformer for Multi-modal 3D Object Detection
- Homography Loss for Monocular 3D Object Detection
- HyperDet3D: Learning a Scene-conditioned 3D Object Detector
- DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection
⭐code - OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data
⭐code - Focal Sparse Convolutional Networks for 3D Object Detection
😮oral⭐code📰paper📓 - Rotationally Equivariant 3D Object Detection
🏠project - Bridged Transformer for Vision and Point Cloud 3D Object Detection
📰paper - Sparse Fuse Dense: Towards High Quality 3D Detection with Depth Completion
📰paper - VISTA: Boosting 3D Object Detection via Dual Cross-VIew SpaTial Attention
⭐code
📰SOTA - Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection
😮oral
- Camouflage Target Detection
- Fully Supervised Object Detection
- Semi-Supervised Object Detection
- Salient Object Detection
- Keypoint Detection
- Affordance grounding
- Image Alignment
- Object Attribute Recognition
- X-Trans2Cap: Cross-Modal Knowledge Transfer using Transformer for 3D Dense Captioning
- Quantifying Societal Bias Amplification in Image Captioning
- NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Models
- It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collection
⭐code🏠project - Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning
- Novel Object Captioning
- Image Restoration
- Image Restoration
- Image Stitching
- Motion Deblur
- image outpainting
- Image Aesthetic Evaluation
- Image Quality Assessment
- Image To Rain
- Image Deblurring
- Image Denoising
- Image Enhancement
- Image Harmonization
- Image Super Completion
- Semantic Image Matching
- FocalClick: Towards Practical Interactive Image Segmentation
⭐code📰paper - Semantic-Aware Domain Generalized Segmentation
😮oral⭐code - ReSTR: Convolution-free Referring Image Segmentation Using Transformers
- Panoptic Neural Fields: A Semantic Object-Aware Neural Scene Representation
🏠project - Instance Segmentation
- E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentation
⭐code📰paper - Sparse Instance Activation for Real-Time Instance Segmentation
⭐code - SharpContour: A Contour-based Boundary Refinement Approach for Efficient and Accurate Instance Segmentation
🏠project - Open-World Instance Segmentation: Exploiting Pseudo Ground Truth From Learned Pairwise Affinity
⭐code🏠project - DArch: Dental Arch Prior-assisted 3D Tooth Instance Segmentation
- Relieving Long-tailed Instance Segmentation via Pairwise Class Balance
⭐code📰解读 - ContrastMask: Contrastive Learning to Segment Every Thing
📰paper - Semi-Supervised Instance Segmentation
- 3D Instance Segmentation
- 🐦️FreeSOLO: Learning to Segment Objects without Annotations
- E2EC: An End-to-End Contour-based Method for High-Quality High-Speed Instance Segmentation
- Semantic Segmentation
- Pin the Memory: Learning to Generalize Semantic Segmentation
⭐code📰paper - Tree Energy Loss: Towards Sparsely Annotated Semantic Segmentation
⭐code📰paper - GroupViT: Semantic Segmentation Emerges from Text Supervision
⭐code🏠project📺video
📰UCSD - Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentation
⭐code📰paper - Deep Hierarchical Semantic Segmentation
⭐code - Semantic Segmentation by Early Region Proxy
⭐code📰paper - SimT: Handling Open-set Noise for Domain Adaptive Semantic Segmentation
⭐code - Rethinking Semantic Segmentation: A Prototype View
😮oral⭐code - On the Road to Online Adaptation for Semantic Image Segmentation
- Threshold Matters in WSSS: Manipulating the Activation for the Robust and Accurate Segmentation Model Against Thresholds
- NightLab: A Dual-level Architecture with Hardness Detection for Segmentation at Night
⭐code📰paper - TopFormer: Token Pyramid Transformer for Mobile Semantic Segmentation
- Cross-Image Relational Knowledge Distillation for Semantic Segmentation
⭐code📰paper - Dynamic Prototype Convolution Network for Few-Shot Semantic Segmentation
- Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers
⭐code - Self-Supervised Learning of Object Parts for Semantic Segmentation
- Cross-view Transformers for real-time Map-view Semantic Segmentation
😮oral⭐code - Deep Spectral Methods: A Surprisingly Strong Baseline for Unsupervised Semantic Segmentation and Localization
🏠project - 3D Semantic Segmentation
- Weakly Supervised Semantic Segmentation
- Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation
⭐code📰paper - Self-supervised Image-specific Prototype Exploration for Weakly Supervised Semantic Segmentation
⭐code - Contrastive learning of Class-agnostic Activation Map for Weakly Supervised Object Localization and Semantic Segmentation
⭐code - Cross Language Image Matching for Weakly Supervised Semantic Segmentation
⭐code - Multi-class Token Transformer for Weakly Supervised Semantic Segmentation
⭐code - Learning Affinity from Attention: End-to-End Weakly-Supervised Semantic Segmentation with Transformers
⭐code📰paper - Weakly Supervised Semantic Segmentation using Out-of-Distribution Data
⭐code📰paper - L2G: A Simple Local-to-Global Knowledge Transfer Framework for Weakly Supervised Semantic Segmentation
⭐code
- Class Re-Activation Maps for Weakly-Supervised Semantic Segmentation
- Semi-Supervised Semantic Segmentation
- Domain Adaptive Semantic Segmentation
- Domain Generalization Semantic Segmentation
- Few-Shot Semantic Segmentation
- Pin the Memory: Learning to Generalize Semantic Segmentation
- Action Segmentation
- Scene Analysis
- FOG Segmentation
- Panoptic Segmentation
- Cutout
👉🏼 Learn Image Segmentation here: https://courses.thinkautonomous.ai/image-segmentation
- Learning to Anticipate Future with Dynamic Context Removal
⭐code📰paper - Learning Optimal K-space Acquisition and Reconstruction using Physics-Informed Neural Networks
- Instance-wise Occlusion and Depth Orders in Natural Scenes
- IFOR: Iterative Flow Minimization for Robotic Object Rearrangement
🏠project - PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence
⭐code🏠project📺video📰paper - CAFE: Learning to Condense Dataset by Aligning Features
⭐code📰paper - Enhancing Adversarial Robustness for Deep Metric Learning
- BatchFormer: Learning to Explore Sample Relationships for Robust Representation Learning
⭐code📰paper📓 - ACVNet: Attention Concatenation Volume for Accurate and Efficient Stereo Matching
⭐code📰paper - Polarity Sampling: Quality and Diversity Control of Pre-Trained Generative Networks via Singular Values
⭐code - Do Explanations Explain? Model Knows Best
⭐code - HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
- E-CIR: Event-Enhanced Continuous Intensity Recovery
⭐code - 🐦️Transferability Estimation using Bhattacharyya Class Separability
- Interpretable part-whole hierarchies and conceptual-semantic relationships in neural networks
⭐code - GlideNet: Global, Local and Intrinsic based Dense Embedding NETwork for Multi-category Attributes Prediction
⭐code - Differentially Private Federated Learning with Local Regularization and Sparsification
- Towards Efficient and Scalable Sharpness-Aware Minimization
- DeltaCNN: End-to-End CNN Inference of Sparse Frame Differences in Videos
- Probabilistic Warp Consistency for Weakly-Supervised Semantic Correspondences
⭐code📰paper - Dynamic Dual-Output Diffusion Models
- Moving Window Regression: A Novel Approach to Ordinal Regression
- Egocentric Prediction of Action Target in 3D
- Compositional Temporal Grounding
with Structured Variational Cross-Graph Correspondence Learning
⭐code - Hierarchical Nearest Neighbor Graph Embedding for Efficient Dimensionality Reduction
⭐code - Neural Reflectance for Shape Recovery with Shadow Handling
⭐code - DyRep: Bootstrapping Training with Dynamic Re-parameterization
⭐code - Enhancing Classifier Conservativeness and Robustness by Polynomiality
- Versatile Multi-Modal Pre-Training for Human-Centric Perception
⭐code - Attributable Visual Similarity Learning
⭐code - Optimizing Elimination Templates by Greedy Parameter Search
- Partially Does It: Towards Scene-Level FG-SBIR with Partial Input
- Bi-level Doubly Variational Learning for Energy-based Latent Variable Models
- Brain-inspired Multilayer Perceptron with Spiking Neurons
- ARCS: Accurate Rotation and Correspondence Search
⭐code - iPLAN: Interactive and Procedural Layout Planning
- HINT: Hierarchical Neuron Concept Explainer
⭐code - Visual Abductive Reasoning
⭐code - A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration
⭐code - Learning Structured Gaussians to Approximate Deep Ensembles
- Self-Supervised Image Representation Learning with Geometric Set Consistency
- Balanced Multimodal Learning via On-the-fly Gradient Modulation
😮oral⭐code - CNN Filter DB: An Empirical Investigation of Trained Convolutional Filters
⭐code - Eigencontours: Novel Contour Descriptors Based on Low-Rank Approximation
😮oral - Pop-Out Motion: 3D-Aware Image Deformation via Learning the Shape Laplacian
- Long-term Visual Map Sparsification with Heterogeneous GNN
- Clean Implicit 3D Structure from Noisy 2D STEM Images
- Equivariance Allows Handling Multiple Nuisance Variables When Analyzing Pooled Neuroimaging Datasets
- CaDeX: Learning Canonical Deformation Coordinate Space for Dynamic Surface Representation via Neural Homeomorphism
⭐code🏠project - Fast Light-Weight Near-Field Photometric Stereo
- Fast, Accurate and Memory-Efficient Partial Permutation Synchronization
- Multi-Robot Active Mapping via Neural Bipartite Graph Matching
- Learning Program Representations for Food Images and Cooking Recipes
😮oral - Iterative Deep Homography Estimation
⭐code - Practical Learned Lossless JPEG Recompression with Multi-Level Cross-Channel Entropy Model in the DCT Domain
- Generating High Fidelity Data from Low-density Regions using Diffusion Models
- Continuous Scene Representations for Embodied AI
⭐code🏠project - It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher
- End-to-End Trajectory Distribution Prediction Based on Occupancy Grid Maps
- Reflection and Rotation Symmetry Detection via Equivariant Learning
- Exploiting Explainable Metrics for Augmented SGD
- On the Importance of Asymmetry for Siamese Representation Learning
⭐code - Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal Regression
- Perception Prioritized Training of Diffusion Models
⭐code - LASER: LAtent SpacE Rendering for 2D Visual Localization
😮oral - Efficient Maximal Coding Rate Reduction by Variational Forms
- Exemplar-bsaed Pattern Synthesis with Implicit Periodic Field Network
- Progressive Minimal Path Method with Embedded CNN
- Online Convolutional Re-parameterization
⭐code - Consistency driven Sequential Transformers Attention Model for Partially Observable Scenes
- Leveraging Equivariant Features for Absolute Pose Regression
- Neural Convolutional Surfaces
🏠project - GLASS: Geometric Latent Augmentation for Shape Spaces
⭐code🏠project - Total Variation Optimization Layers for Computer Vision
- Identifying Ambiguous Similarity Conditions via Semantic Matching
⭐code📰paper - TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates
- Gravitationally Lensed Black Hole Emission Tomography
⭐code🏠project📺video - Robust and Accurate Superquadric Recovery: a Probabilistic Approach
⭐code - Projective Manifold Gradient Layer for Deep Rotation Regression
⭐code - Habitat-Web: Learning Embodied Object-Search Strategies from Human Demonstrations at Scale
⭐code - Single-Photon Structured Light
- Explaining Deep Convolutional Neural Networks via Latent Visual-Semantic Filter Attention
😮oral⭐code - Defensive Patches for Robust Recognition in the Physical World
⭐code📰paper - Event-aided Direct Sparse Odometry
😮oral⭐code🏠project📺video - Deep Unlearning via Randomized Conditionally Independent Hessians
⭐code - Learning to Imagine: Diversify Memory for Incremental Learning using Unlabeled Data
- Towards Data-Free Model Stealing in a Hard Label Setting
⭐code🏠project - Proto2Proto: Can you recognize the car, the way I do?
⭐code - Balanced MSE for Imbalanced Visual Regression
😮oral⭐code
📰CVPR 2022 (Oral) | 回归标签不平衡? 试试Balanced MSE - Leveraging Unlabeled Data for Sketch-based Understanding
- Fixing Malfunctional Objects With Learned Physical Simulation and Functional Prediction
⭐code🏠project - Scaling Up Your Kernels to 31x31: Revisiting Large Kernel Design in CNNs
⭐code📰paper - RepMLPNet: Hierarchical Vision MLP with Re-parameterized Locality
⭐code📰paper - An Image Patch is a Wave: Quantum Inspired Vision MLP
😮oral⭐code - A ConvNet for the 2020s
⭐code - NeuralHDHair: Automatic High-fidelity Hair Modeling from a Single Image Using Implicit Neural Representations
- A Unified Framework for Implicit Sinkhorn Differentiation
⭐code
📰paper - Towards Better Understanding Attribution Methods
⭐code
-
Camera Relocation
- ❌[SceneSqueezer: Learning to Compress Scene for Camera Relocalization]
😮oral
- ❌[SceneSqueezer: Learning to Compress Scene for Camera Relocalization]
-
Camera Imaging
- ❌[Learning to Zoom Inside Camera Imaging Pipeline]
- ❌[Learning to Zoom Inside Camera Imaging Pipeline]
-
Homography Estimation(旋转估计)
-
3D人体重建
-
图像字幕
- ❌[Comprehending and Ordering Semantics for Image Captioning]
📰解读
- ❌[Comprehending and Ordering Semantics for Image Captioning]
-
图像去雾
- ❌[Self-augmented Unpaired Image Dehazing via Density and Depth Decomposition]
📰解读
- ❌[Self-augmented Unpaired Image Dehazing via Density and Depth Decomposition]
-
图像到图像翻译
- ❌[Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint]
📰解读
- ❌[Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint]
-
光流
-
图像生成
- ❌[Modeling Image Composition for Complex Scene Generation]
📰解读
- ❌[Modeling Image Composition for Complex Scene Generation]
-
连续学习
- ❌[Continual Learning with Lifelong Vision Transformer]
📰解读
- ❌[Continual Learning with Lifelong Vision Transformer]
-
元学习
- ❌[Learning to Learn and Remember Super Long Multi-Domain Task Sequence]
📰解读
- ❌[Learning to Learn and Remember Super Long Multi-Domain Task Sequence]
-
目标检测
-
HOI
- ❌[Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection]
📰解读
- ❌[Exploring Structure-aware Transformer over Interaction Proposals for Human-Object Interaction Detection]
-
视频建模
- ❌[Stand-Alone Inter-Frame Attention in Video Models]
📰解读
- ❌[Stand-Alone Inter-Frame Attention in Video Models]
-
其他
-
视频场景分割
- ❌[Scene Consistency Representation Learning for Video Scene Segmentation]
📰解读
- ❌[Scene Consistency Representation Learning for Video Scene Segmentation]
-
图像字幕
- ❌[DIFNet: Boosting Visual Information Flow for Image Captioning]
📰解读
- ❌[DIFNet: Boosting Visual Information Flow for Image Captioning]
-
姿态
- ❌[Location-Free Human Pose Estimation]
📰解读
- ❌[Location-Free Human Pose Estimation]
-
小样本
-
点云
-
人脸
-
目标检测
- ❌[Thinking Camouflaged Object Detection in Frequency]
📰解读
- ❌[Thinking Camouflaged Object Detection in Frequency]
-
对抗
- ❌[Efficent Data-free Model Stealing for Black-box Adversarial Attacks]
📰解读
- ❌[Efficent Data-free Model Stealing for Black-box Adversarial Attacks]
-
分割
-
3D场景
- ❌[Canonical Voting: Towards Robust Oriented Bounding Box Detection in 3D Scenes]
📰paper
- ❌[Canonical Voting: Towards Robust Oriented Bounding Box Detection in 3D Scenes]
-
行人轨迹预测
- ❌[Human Trajectory Prediction with Momentary Observation]
📰paper
- ❌[Human Trajectory Prediction with Momentary Observation]
AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval
Diverse Plausible 360-Degree Image Outpainting for Efficient 3DCG Background Creation
Source
[Two Systems in Thinking: Dual-System Transformer for Grounded Situation Recognition]
[Autoregressive Image Generation using Residual Quantization]
✔️Instance-wise Occlusion and Depth Orders in Natural Scenes
[Style Neophile: Constantly Seeking Novel Styles for Domain Generalization]
[ReSTR: Convolution-free Referring Image Segmentation Using Transformers]
[FIFO: Learning Fog-invariant Features for Foggy Scene Segmentation]
[TransforMatcher: Match-to-Match Attention for Semantic Correspondence]
[Reflection and Rotation Symmetry Detection via Equivariant Learning]
[Semi-supervised Semantic Segmentation with Error Localization Network]
[Future Transformer for Long-term Action Anticipation]
[Self-Taught Metric Learning without Labels]
✔️Fast Point Transformer
[Integrative Few-Shot Learning for Classification and Segmentation]
[Scene Painting via Semantic Image Synthesis]
[Detector-Free Weakly Supervised Group Activity Recognition]