Skip to content

FireFistisDead/Deepfake-Detection

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

29 Commits
 
 
 
 
 
 

Repository files navigation

Audio Deepfake Detection Resources

A curated list of tools, papers, and resources related to audio deepfake detection, with a focus on fine-tuning deep learning models such as AASIST, RawNet2, and LCNN.

This repository is dedicated to showcasing practical and research-oriented resources for detecting audio deepfakes. If you would like to contribute, feel free to submit a pull request or open an issue.


📘 Index


Datasets

Competitions

Tools

Baseline Models

  • AASIST: Spectro-temporal graph attention network for anti-spoofing.
  • RawNet2: End-to-end deep model working directly on raw waveforms.
  • LCNN: Lightweight CNN model using Max-Feature-Map activations.

Surveys and Reviews

  • Cohen et al., “A Study on Data Augmentation in Voice Anti-Spoofing”, Ben Gurion University, 2022.
  • Almutairi and Elgibreen, “A Review of Modern Audio Deepfake Detection Methods”, King Saud University, 2022.
  • Khanjani et al., “Audio Deepfakes: A Survey”, University of Maryland, 2023.
  • Khan et al., “Voice Spoofing Attacks and Countermeasures”, Oakland University, 2023.
  • Dixit et al., “Review of Audio Deepfake Detection Techniques”, Panjab University, 2023.
  • Yi et al., “Audio Deepfake Detection: A Survey”, CASIA, 2023.

Recent Research Papers

  1. Audio Deepfake Detection: A Survey
    Authors: Jiangyan Yi, Chenglong Wang, Jianhua Tao, Xiaohui Zhang, Chu Yuan Zhang, Yan Zhao
    Publication Year: 2023
    Link to paper

  2. Audio Deepfakes: A Survey
    Authors: Fariborz Taherkhani, Nasir Memon, Arun Ross
    Publication Year: 2022
    Link to paper

  3. Cross-Domain Audio Deepfake Detection: Dataset and Analysis
    Authors: Xinrui Yan, Jiangyan Yi, Jianhua Tao, Jie Chen
    Publication Year: 2024
    Link to paper

  4. Audio-deepfake detection: Adversarial attacks and countermeasures
    Authors: Not specified
    Publication Year: 2024
    Link to paper

  5. Navigating the Soundscape of Deception: A Comprehensive Survey on Audio Deepfake Generation, Detection, and Future Horizons
    Authors: Taiba Majid Wani, Syed Asif Ahmad Qadri, Farooq Ahmad Wani, Irene Amerini
    Publication Year: 2024
    Link to paper

  6. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  7. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  8. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  9. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  10. WaveFake: A Data Set to Facilitate Audio Deepfake Detection
    Authors: Not specified
    Publication Year: 2021
    Link to paper

  11. Audio Deepfake Detection
    Authors: Not specified
    Publication Year: Not specified
    Link to paper

  12. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  13. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  14. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  15. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  16. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  17. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  18. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  19. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper

  20. Audio Deepfake Detection: A Survey
    Authors: Not specified
    Publication Year: 2023
    Link to paper


AAAI

2025

  • Region-Based Optimization in Continual Learning for Audio Deepfake Detection paper
  • Improving Generalization for AI-Synthesized Voice Detection paper

2024

  • What to remember: Self-adaptive continual learning for audio deepfake detection paper

ICML

2023

  • Do You Remember? Overcoming Catastrophic Forgetting for Fake Audio Detectionpaper

ICLR

2025

  • I Can Hear You: Selective Robust Training for Deepfake Audio Detection Accept! congratulations
  • SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Toward Cutting-Edge Speech Generation Methods reject,pity
  • Contrastive Learning from Synthetic Audio Doppelgängers augmentation paper, Accept
  • SONICS: Synthetic Or Not - Identifying Counterfeit Songs. paper

interspeech website

2024

ASVSPOOF5_2024

  • Anti-spoofing Ensembling Model: Dynamic Weight Allocation in Ensemble Models for Improved Voice Biometrics Security paper
  • Spoof Diarization: ""What Spoofed When"" in Partially Spoofed Audio paper
  • Spoofing Speech Detection by Modeling Local Spectro-Temporal and Long-term Dependency paper
  • Improving Copy-Synthesis Anti-Spoofing Training Method with Rhythm and Speaker Perturbation paper
  • Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection paper
  • Source Tracing of Audio Deepfake Systems paper
  • How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio? paper
  • Revisiting and Improving Scoring Fusion for Spoofing-aware Speaker Verification Using Compositional Data Analysis paper
  • SecureSpectra: Safeguarding Digital Identity from Deep Fake Threats via Intelligent Signatures paper
  • Interpretable Temporal Class Activation Representation for Audio Spoofing Detection paper
  • DGPN: A Dual Graph Prototypical Network for Few-Shot Speech Spoofing Algorithm Recognition paper
  • CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems paper
  • Spoofed Speech Detection with a Focus on Speaker Embedding paper
  • Exploring Self-supervised Embeddings and Synthetic Data Augmentation for Robust Audio Deepfake Detection paper
  • One-class learning with adaptive centroid shift for audio deepfake detection paper
  • Towards generalisable and calibrated audio deepfake detection with self-supervised representations paper
  • Singing Voice Graph Modeling for SingFake Detection paper
  • Genuine-Focused Learning using Mask AutoEncoder for Generalized Fake Audio Detection paper
  • Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism paper
  • To what extent can ASV systems naturally defend against spoofing attacks? paper
  • Balance, Multiple Augmentation, and Re-synthesis: A Triad Training Strategy for Enhanced Audio Deepfake Detection paper
  • Speech Formants Integration for Generalized Detection of Synthetic Speech Spoofing Attacks paper
  • Adapter Learning from Pre-trained Model for Robust Spoof Speech Detection paper
  • Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection paper
  • Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio paper
  • Frequency-mix Knowledge Distillation for Fake Speech Detection paper
  • HarmoNet: Partial DeepFake Detection Network based on Multi-scale HarmoF0 Feature Fusion paper
  • A New Approach to Voice Authenticity paper
  • Prompt Tuning for Audio Deepfake Detection: Computationally Efficient Test-time Domain Adaptation with Limited Target Dataset paper
  • Harder or Different? Understanding Generalization of Audio Deepfake Detection paper
  • RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection paper
  • Generalized Fake Audio Detection via Deep Stable Learning paper
  • CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection paper
  • FakeSound: Deepfake General Audio Detection paper

2023 papers

  • Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms paper
  • Malafide: a novel adversarial convolutive noise attack against deepfake and spoofing detection systems paper
  • How to Construct Perfect and Worse-than-Coin-Flip Spoofing Countermeasures: A Word of Warning on Shortcut Learning paper
  • Spoofing Attacker Also Benefits from Self-Supervised Pretrained Model paper
  • Towards single integrated spoofing-aware speaker verification embeddings paper
  • DoubleDeceiver: Deceiving the Speaker Verification System Protected by Spoofing Countermeasures paper
  • Speaker-Aware Anti-spoofing paper
  • Range-Based Equal Error Rate for Spoof Localization paper
  • A conformer-based classifier for variable-length utterance processing in anti-spoofing paper
  • Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing paper
  • Phase perturbation improves channel robustness for speech spoofing countermeasures paper
  • Towards Attention-based Contrastive Learning for Audio Spoof Detection paper
  • Synthetic Voice Spoofing Detection based on Feature Pyramid Conformer paper
  • Robust audio anti-spoofing countermeasure with joint training of front-end and back-end models paper

ICASSP website

2025

  • Fooling the Forgers: A Multi-Stage Framework for Audio Deepfake Detection paper
  • WaveSpect: A Hybrid Approach to Synthetic Audio Detection via Waveform and Spectrogram Analysis paper
  • FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning paper
  • LlamaPartialSpoof: An LLM-Driven Fake Speech Dataset Simulating Disinformation Generation paper
  • What Affects the Performance of Fake Audio Detection? Analyzing Factors in a Continual Learning Setting paper
  • Adversarial Training and Gradient Optimization for Partially Deepfake Audio Localization paper
  • Leveraging Mixture of Experts for Improved Speech Deepfake Detection paper
  • Freeze and Learn: Continual Learning with Selective Freezing for Speech Deepfake Detection paper
  • Integrating Spectro-Temporal Cross Aggregation and Multi-Scale Dynamic Learning for Audio Deepfake Detection paper
  • Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0 paper
  • Easy, Interpretable, Effective: openSMILE for voice deepfake detection paper
  • Robust Audio Deepfake Detection using Ensemble Confidence Calibration paper
  • Generalize Audio Deepfake Algorithm Recognition via Attribution Enhancement paper
  • From Voices to Beats: Enhancing Music Deepfake Detection by Identifying Forgeries in Background paper
  • Wave-Spectrogram Cross-Modal Aggregation for Audio Deepfake Detection paper
  • Generalizable Audio Deepfake Detection via Latent Space Refinement and Augmentation paper
  • SpecViT: A Custom Vision-Transformer based Approach for Audio Deepfake Detection paper
  • Deepfake Detection of Singing Voices With Whisper Encodings paper
  • Continual Unsupervised Domain Adaptation for Audio Deepfake Detection paper
  • Audio Features Investigation for Singing Voice Deepfake Detection paper
  • Investigating voiced and unvoiced regions of speech for audio deepfake detection paper
  • What Does an Audio Deepfake Detector Focus on? A Study in the Time Domain paper
  • PET: High-Frequency Temporal Self-Consistency Learning for Partially Deepfake Audio Localization paper
  • GNCL: A Graph Neural Network with Consistency Loss for Segment-Level Spoofed Speech Detection paper

2024

  • Robust Spoof Speech Detection Based on Multi-Scale Feature Aggregation and Dynamic Convolution paper
  • Can Large-Scale Vocoded Spoofed Data Improve Speech Spoofing Countermeasure with a Self-Supervised Front End? paper
  • Frame-to-Utterance Convergence: A Spectra-Temporal Approach for Unified Spoofing Detection paper
  • CPAUG: Refining Copy-Paste Augmentation for Speech Anti-Spoofing paper
  • One-Class Knowledge Distillation for Spoofing Speech Detection paper
  • An Efficient Temporary Deepfake Location Approach Based Embeddings for Partially Spoofed Audio Detection paper
  • Selective Domain-Invariant Feature for Generalizable Deepfake Detection paper
  • Multi-Scale Permutation Entropy for Audio Deepfake Detection paper
  • A Green Learning Approach to Spoofed Speech Detection paper
  • Spoofing Attack Augmentation: Can Differently-Trained Attack Models Improve Generalisation? paper
  • Improving Short Utterance Anti-Spoofing with Aasist2 paper
  • FSD: An Initial Chinese Dataset for Fake Song Detection paper
  • A Robust Audio Deepfake Detection System via Multi-View Feature paper
  • Audio Deepfake Detection With Self-Supervised Wavlm And Multi-Fusion Attentive Classifier paper
  • Does Audio Deepfake Detection Rely on Artifacts? paper
  • SingFake: Singing Voice Deepfake Detection paper
  • VFD-Net: Vocoder Fingerprints Detection for Fake Audio paper
  • HM-CONFORMER: A Conformer-Based Audio Deepfake Detection System with Hierarchical Pooling and Multi-Level Classification Token Aggregation Methods paper

2023

  • Learning From Yourself: A Self-Distillation Method for Fake Speech Detection paper
  • Can spoofing countermeasure and speaker verification systems be jointly optimised?? paper
  • Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoders paper
  • Phase-Aware Spoof Speech Detection Based on Res2Net with Phase Network paper
  • Leveraging Positional-Related Local-Global Dependency for Synthetic Speech Detection paper
  • Reliability Estimation for Synthetic Speech Detection paper

jestech

  • Enhancing voice spoofing detection in noisy environments using frequency feature masking augmentation. paper

TMLR

  • Towards generalizing deep-audio-fake detection networks paper code

information fusion

  • Hierarchical multi-source cues fusion for mono-to-binaural based Audio Deepfake Detection. paper

speech communication

  • One-class network leveraging spectro-temporal features for generalized synthetic speech detection paper

TASLP website

  • ASSD: An AI-Synthesized Speech Detection Scheme Using Whisper Feature and Types Classification paper
  • The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio paper
  • Generalizable Speech Spoofing Detection Against Silence Trimming With Data Augmentation and Multi-Task Meta-Learning paper
  • Dual-Branch Knowledge Distillation for Noise-Robust Synthetic Speech Detection trash(this is personal)
  • Compact Time-Domain Representation for Logical Access Spoofed Audio paper
  • The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance paper
  • ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild paper
  • The Impact of Silence on Speech Anti-Spoofing paper
  • Generalized Voice Spoofing Detection via Integral Knowledge Amalgamation paper
  • Device Features Based on Linear Transformation With Parallel Training Data for Replay Speech Detection paper
  • Robustness of Speech Spoofing Detectors Against Adversarial Post-Processing of Voice Conversion paper
  • Modified Magnitude-Phase Spectrum Information for Spoofing Detection paper
  • Optimizing Tandem Speaker Verification and Anti-Spoofing Systems paper
  • FTDKD: Frequency-Time Domain Knowledge Distillation for Low-Quality Compressed Audio Deepfake Detection paper

TIFS website

  • On Joint Optimization of Automatic Speaker Verification and Anti-Spoofing in the Embedding Space paper
  • Domain Generalization via Aggregation and Separation for Audio Deepfake Detection paper
  • Audio Multi-View Spoofing Detection Framework Based on Audio-Text-Emotion Correlations paper
  • One-Class Learning Towards Synthetic Voice Spoofing Detection paper
  • Synthetic Speech Detection Based on Local Autoregression and Variance Statistics paper
  • The Role of Long-Term Dependency in Synthetic Speech Detection paper
  • Comparative Analysis of ASV Spoofing Countermeasures: Evaluating Res2Net-Based Approaches paper
  • Discriminative Frequency Information Learning for End-to-End Speech Anti-Spoofing paper
  • End-to-End Dual-Branch Network Towards Synthetic Speech Detection paper
  • Towards End-to-End Synthetic Speech Detection paper
  • Synthetic Speech Detection Based on the Temporal Consistency of Speaker Features paper
  • Multi-Level Information Aggregation Based Graph Attention Networks Towards Fake Speech Detection paper
  • Compressed Domain Invariant Adversarial Representation Learning for Robust Audio Deepfake Detection. paper

ACMMM

  • Coarse-to-Fine Proposal Refinement Framework for Audio Temporal Forgery Detection and Localization paper
  • Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier paper

SLT

2022

  • How to Boost Anti-Spoofing with X-Vectors paper
  • Investigating Active-Learning-Based Training Data Selection for Speech Spoofing Countermeasure paper
  • The Clever Hans Effect in Voice Spoofing Detection paper

other

  • Fixing Domain Bias for Generalized Deepfake Detection paper
  • Learning to Listen and Listening to Learn: Spoofed Audio Detection Through Linguistic Data Augmentation paper
  • RawSpectrogram: On the Way to Effective Streaming Speech Anti-Spoofing paper
  • Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation paper
  • Experimental Case Study of Self-Supervised Learning for Voice Spoofing Detection paper
  • Investigating Self-Supervised Front Ends for Speech Spoofing Countermeasures paper
  • Investigating Active-Learning-Based Training Data Selection for Speech Spoofing Countermeasure paper
  • SLIM: Style-Linguistics Mismatch Model for Generalized Audio Deepfake Detection paper
  • Audio Deepfake Detection with Self-Supervised XLS-R and SLS Classifier paper

enlightening

  • Your Out-of-Distribution Detection Method is Not Robust! paper code
  • Watermarking for Out-of-distribution Detection paper code

This list is non-exhaustive and will be updated regularly as the field continues to evolve.

About

Documentation and implementation of Deep Learning model to detect Deepfake AI generateed Voices

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages