arXiv:2605.29531cs.SDcs.CV2026-05

提出轻量模型CAFNet,能精准识别真假混杂的音频伪造并定位篡改位置。

Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion

论文配图:Audio Deepfake Detection with Half-Truth Localisation Using Cross-Attentive Feature Fusion
图 1 · 摘自论文原文
  • 用跨注意力融合三种声学特征,实现真假混合音频的联合检测与定位
  • 在多语种数据集上达到92.71%准确率,定位误差仅0.075秒
  • 参数量仅57.6万,远低于现有模型,适合实际部署

音频深度伪造检测长期被视为二分类问题,但部分篡改语音——即在真实语句中插入一段合成片段——构成更现实且更具挑战性的威胁。检测此类半真半假音频不仅需区分真实、全伪造和半真半假三类,还需精确定位篡改区域。本文提出CAFNet,一个仅576,000参数的架构,可在一个前向传播中完成三分类(真实、全伪造、半真半假)与时间边界回归。CAFNet通过并行深度可分离卷积分支融合梅尔倒谱系数(MFCC)、线性倒谱系数(LFCC)与染色短时傅里叶变换(Chroma-STFT)特征,并引入跨注意力机制;随后使用双向长短期记忆网络(BiLSTM)作为回归头预测篡改边界。在合并的多语言音频深度伪造检测语料库(MLADDC)T2+T3测试集上,CAFNet实现92.71%准确率与0.9910的宏AUC,边界定位平均绝对误差(MAE)为0.075秒,中位误差0.052秒。在二分类任务中,其准确率达96.76%,等错误率(EER)为3.20%,显著优于微调后的XLS-R 300M(78.31%)与AST 87M(93.03%),且参数量不足后者的1/500。跨数据集实验表明,标准微调会破坏跨域表示能力,即使降低主干学习率亦然。

原文摘要 · Abstract (English)

Audio deepfake detection is well-studied as a binary problem, but partially manipulated speech, where a short synthesised segment is spliced into an otherwise genuine utterance, poses a harder and more realistic threat. Detecting such half-truth audio requires not only distinguishing it from real and fully fake speech, but also localising where the manipulation occurs. We present CAFNet, a 576k-parameter architecture that addresses both tasks jointly: it performs ternary classification (real, fully-fake, or half-truth) and regresses the temporal boundaries of the synthesised region in a single forward pass. CAFNet fuses Mel-Frequency Cepstral Coefficient (MFCC), Linear-Frequency Cepstral Coefficient (LFCC), and Chroma Short-Time Fourier Transform (Chroma-STFT) features through parallel depthwise-separable convolution branches with cross-attention, followed by a Bidirectional Long Short-Term Memory (BiLSTM) regression head for boundary prediction. On the combined Multi-Lingual Audio Deepfake Detection Corpus (MLADDC) T2+T3 test set, CAFNet achieves 92.71% accuracy and macro Area Under the Curve (AUC) of 0.9910, with boundary localisation Mean Absolute Error (MAE) of 0.075s and a median error of 0.052s. On binary detection, it achieves 96.76% accuracy and 3.20% Equal Error Rate (EER), outperforming fine-tuned XLS-R 300M (78.31%) and AST 87M (93.03%) at over 500 times fewer parameters. A cross-dataset study further shows that standard fine-tuning collapses cross-domain representations even under reduced backbone learning rates.

音频伪造定位检测轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。