构建首个音素级语音伪造数据集,用于检测与自然度评估。
PhonemeDF: A Synthetic Speech Dataset for Audio Deepfake Detection and Naturalness Evaluation
- 构建音素级真实与合成语音对比数据集
- 通过KLD衡量音素分布相似性,发现与检测性能相关
- 适合语音安全、深度伪造检测研究者使用
AI生成语音日益逼真,给语音生物识别安全和防止虚假语音传播带来挑战。现有资源缺乏音素层级的自然度评估手段。本文提出音素级深度伪造数据集(PhonemeDF),包含从LibriSpeech子集获取的真实语音,以及使用四种TTS和三种VC系统生成的合成语音。通过Montreal Forced Aligner(MFA)对齐音素,计算真实与合成语音音素分布的Kullback-Leibler散度(KLD),量化生成质量。结果显示,真实与合成音素分布的KLD值与分类器区分能力显著相关,表明KLD可作为鉴别关键音素的指标。
原文摘要 · Abstract (English)
The growing sophistication of speech generated by Artificial Intelligence (AI) has introduced new challenges in audio deepfake detection. Text-to-speech (TTS) and voice conversion (VC) technologies can create highly convincing synthetic speech with naturalness and intelligibility. This poses serious threats to voice biometric security and to systems designed to combat the spread of spoken misinformation, where synthetic voices may be used to disseminate false or malicious content. While interest in AI-generated speech has increased, resources for evaluating naturalness at the phoneme level remain limited. In this work, we address this gap by presenting the Phoneme-Level DeepFake dataset (PhonemeDF), comprising parallel real and synthetic speech segmented at the phoneme level. Real speech samples are derived from a subset of LibriSpeech, while synthetic samples are generated using four TTS and three VC systems. For each system, phoneme-aligned TextGrid files are obtained using the Montreal Forced Aligner (MFA). We compute the Kullback-Leibler divergence (KLD) between real and synthetic phoneme distributions to quantify fidelity and establish a ranking based on similarity to natural speech. Our findings show a clear correlation between the KLD of real and synthetic phoneme distributions and the performance of classifiers trained to distinguish them, suggesting that KLD can serve as an indicator of the most discriminative phonemes for deepfake detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。