#

audio-visual-correspondence

Here are 11 public repositories matching this topic...

stoneMo / DeepAVFusion

Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".

attention-mechanism multimodal-learning self-supervised-learning sound-source-localization transformer-architecture audio-visual-correspondence audio-visual-learning masked-autoencoder sound-source-separation masked-image-modeling

Updated Aug 2, 2024
Python

stoneMo / AVGN

Official implementation for AVGN

weakly-supervised-learning audio-visual-correspondence audio-visual-learning visual-sound-localization

Updated Mar 24, 2023
Python

stoneMo / EZ-VSL

Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)

self-supervised-learning audio-visual-correspondence audio-visual-learning visual-sound-localization

Updated Oct 2, 2022
Python

swimmiing / ACL-SSL

Repository of the IJCV'26 & WACV'24 paper

self-supervised-learning audio-visual-correspondence visual-sound-localization audio-visual-segmentation

Updated Apr 27, 2026
Python

stoneMo / SLAVC

Official Codebase of "A Closer Look at Weakly-Supervised Audio-Visual Source Localization" (NeurIPS 2022)

silence overfitting self-supervised-learning audio-visual-correspondence audio-visual-learning visual-sound-localization

Updated Dec 6, 2022
Python

stoneMo / CIGN

Official implementation for CIGN

continual-learning audio-visual-correspondence audio-visual-learning class-incremental-learning

Updated Sep 11, 2023
Python

Surrey-UP-Lab / AV-GS

AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis

spatial-audio audio-visual-correspondence gaussian-splatting

Updated Oct 3, 2024

stoneMo / OneAVM

Official Codebase of "A Unified Audio-Visual Learning Framework for Localization, Separation, and Recognition" (ICML 2023)

multimodal-learning self-supervised-learning sound-source-localization audio-visual-correspondence audio-visual-learning sound-source-separation

Updated Jun 1, 2023

stoneMo / EZ-AVGZL

Official Codebase of "Audio-visual Generalized Zero-shot Learning the Easy Way" (ECCV 2024)

zero-shot-learning generalized-zero-shot-learning audio-visual-correspondence audio-visual-learning audio-visual-features

Updated Sep 26, 2024

rsmbyk / objects-that-sound

Implementation of `Objects that Sound` and `Look, Listen, and Learn` papers by Relja Arandjelovi´c and Andrew Zisserman

deep-learning convolutional-neural-networks cross-modal self-supervision audio-visual-correspondence

Updated Sep 25, 2020
Python

abdul1ah / Self-Supervised-Audio-Visual-Consistency-and-Manipulation-Detection-System

A PyTorch-based Deepfake detection API that spots manipulated media by analyzing the kinematic synchronization between facial movements and audio spectrograms. Built with a dual-stream 3D/2D CNN architecture and a FastAPI backend optimized for both pristine laboratory data and noisy real-world web video.

deep-neural-networks computer-vision deep-learning pytorch resnet audio-processing 3d-cnn mtcnn-face-detection fastapi multi-modal-learning audio-visual-correspondence

Updated May 18, 2026
Python

Improve this page

Add a description, image, and links to the audio-visual-correspondence topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the audio-visual-correspondence topic, visit your repo's landing page and select "manage topics."