用异常检测方法识别语音伪造,还能定位问题区域。
Anomaly Detection and Localization for Speech Deepfakes via Feature Pyramid Matching
- 仅用真实语音训练,将伪造音视为异常。
- 在多个数据集上达到95%以上检测准确率。
- 生成可解释的异常热力图,适合安全审查场景。
生成式AI的发展催生了高度逼真的语音伪造技术——能够模仿目标说话人声音的合成音频信号——引发严重的安全担忧。现有语音伪造检测方法多依赖监督学习,存在两个关键缺陷:对未见合成技术泛化能力差,且缺乏可解释性。本文提出一种新型可解释的一类检测框架,将语音伪造检测重构为异常检测任务。模型仅在真实语音上训练以刻画其分布,从而将分布外样本判别为合成生成。此外,该框架在推理阶段生成可解释的异常映射,突出时间与频率域中的异常区域。通过学生-教师特征金字塔匹配系统,并引入差异缩放机制,提升了对未见数据分布的泛化能力。大量实验表明,该方法优于对比基线,验证了将语音伪造检测视为异常检测问题的有效性。
原文摘要 · Abstract (English)
The rise of AI-driven generative models has enabled the creation of highly realistic speech deepfakes - synthetic audio signals that can imitate target speakers' voices - raising critical security concerns. Existing methods for detecting speech deepfakes primarily rely on supervised learning, which suffers from two critical limitations: limited generalization to unseen synthesis techniques and a lack of explainability. In this paper, we address these issues by introducing a novel interpretable one-class detection framework, which reframes speech deepfake detection as an anomaly detection task. Our model is trained exclusively on real speech to characterize its distribution, enabling the classification of out-of-distribution samples as synthetically generated. Additionally, our framework produces interpretable anomaly maps during inference, highlighting anomalous regions across both time and frequency domains. This is done through a Student-Teacher Feature Pyramid Matching system, enhanced with Discrepancy Scaling to improve generalization capabilities across unseen data distributions. Extensive evaluations demonstrate the superior performance of our approach compared to the considered baselines, validating the effectiveness of framing speech deepfake detection as an anomaly detection problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。