arXiv:2606.15454eess.AScs.SD2026-06被引 1

让语音伪造检测可解释,按发音类别精准定位造假痕迹。

Phonetically Explainable Speech Deepfake Detection

论文配图:Phonetically Explainable Speech Deepfake Detection
图 1 · 摘自论文原文
  • 用发音类别引导注意力机制,动态聚焦关键语音段。
  • 停顿、摩擦音等发音类别的判别力最强,周期性元音较弱。
  • 无需事后解释,模型天然具备发音层面的可读性,适合安全审计。

语音伪造检测传统上被视为黑箱分类任务,所有时间帧被同等处理,忽略了不同发音类别携带的判别信息差异。为此,我们提出一种基于音素的交叉注意力框架,将检测转化为可解释、以发音为基础的过程。通过分解伪造后验概率 $P(\text{spoofed}\mid X, W)$,其中 $X$ 为声学表示,$W$ 为音素后验图,得到 $P(\text{spoofed} \mid X, W) = \sum_{i=1}^{M} w_i \cdot P(\text{spoofed} \mid X, Z = z_i)$,$M$ 为音素类别数,$w_i$ 为第 $i$ 类音素在语句中的出现频率。该框架采用基于Transformer的结构,通过音素查询在声学键值中选择性探测信息,归一化池化输出显式音素存在权重。与依赖事后解释的方法不同,本框架实现“设计即可解释”。在LJSpeech衍生数据集、ASVspoof 2019 LA及ASVspoof 5 Track 1上评估,结果表明:发音类别判别力集中于生成模型难以精确还原的发音类型,如塞音、擦音、塞擦音、鼻音及静音边界闭合,而周期性元音和半元音判别力较低。模型不仅性能优异,还提供可检查的逐发音类别决策分解。

原文摘要 · Abstract (English)

Speech deepfake detection is predominantly treated as an opaque classification task where all temporal frames are aggregated equally. This ignores that different phonetic categories carry vastly different amounts of discriminative information. To address this, we propose a phoneme-guided cross-attention framework that transforms detection into an interpretable, phonetically grounded process. We factorize the spoofing posterior $P(\text{spoofed}\mid X, W)$, conditioned on the acoustic representation $X$ and the phonetic posteriorgram $W$. The resulting factorization can be written as $P(\text{spoofed} \mid X, W) = \sum_{i=1}^{M} w_i \cdot P(\text{spoofed} \mid X, Z = z_i)$, where $M$ denotes the number of phonetic classes, $P(\text{spoofed} \mid X, Z = z_i)$ is the spoofing probability for the $i$-th phonetic class $z_i$ conditioned on $X$, and each $w_i$ is the prevalence of phonetic class $z_i$ in the utterance. Our transformer-based architecture instantiates this through a cross-attention block in which phonetic queries selectively probe information in acoustic keys and values, with softmax-normalized pooling supplying explicit phone-presence weights. Unlike prior approaches that rely heavily on post-hoc explainability methods, our framework offers phonetic-explainability-by-design. We evaluate the framework on an LJSpeech-derived corpus, ASVspoof 2019 LA, and ASVspoof 5 Track 1. Per-phone importance rankings reveal that discriminative power concentrates on articulatory categories that generative models struggle to reproduce faithfully. Stops, fricatives, affricates, nasals, and silence-boundary closures rank most discriminative, while periodic vowels and semivowels rank lower. Beyond competitive performance, our model provides structural interpretability, yielding an inspectable per-articulatory category breakdown of the final verdict.

语音伪造可解释性音素分析对抗检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。