用嵌入向量扰动保护语音,防伪造更有效。
RoVo: Robust Voice Protection Against Unauthorized Speech Synthesis with Embedding-Level Perturbations
- 在音频嵌入层注入对抗扰动,重构受保护语音
- 防御成功率提升70%以上,商用验证达99.5%
- 抗语音增强处理,适合真实场景防护
随着深度语音等基于AI的语音合成技术发展,未经授权使用他人声音进行语音欺骗(如语音诈骗、假新闻)的风险日益增加。现有直接在音频信号中注入对抗扰动的防御方法效果有限,因易被语音增强技术消除。为此,我们提出RoVo(Robust Voice),一种新型主动防御机制:将对抗扰动注入音频信号的高维嵌入向量中,重建为受保护语音。该方法有效抵御语音合成攻击,并对语音增强模型(次级攻击威胁)具有强抵抗力。大量实验表明,相比未保护语音,RoVo在四种先进语音合成模型上防御成功率(DSR)提升超70%;在商用语音验证API上达到99.5%的DSR,有效阻断合成攻击。即使在强语音增强条件下,其扰动仍保持鲁棒性,优于传统方法。用户研究表明,受保护语音自然度与可用性均得以保留,适用于复杂多变的现实威胁场景。
原文摘要 · Abstract (English)
With the advancement of AI-based speech synthesis technologies such as Deep Voice, there is an increasing risk of voice spoofing attacks, including voice phishing and fake news, through unauthorized use of others' voices. Existing defenses that inject adversarial perturbations directly into audio signals have limited effectiveness, as these perturbations can easily be neutralized by speech enhancement methods. To overcome this limitation, we propose RoVo (Robust Voice), a novel proactive defense technique that injects adversarial perturbations into high-dimensional embedding vectors of audio signals, reconstructing them into protected speech. This approach effectively defends against speech synthesis attacks and also provides strong resistance to speech enhancement models, which represent a secondary attack threat. In extensive experiments, RoVo increased the Defense Success Rate (DSR) by over 70% compared to unprotected speech, across four state-of-the-art speech synthesis models. Specifically, RoVo achieved a DSR of 99.5% on a commercial speaker-verification API, effectively neutralizing speech synthesis attack. Moreover, RoVo's perturbations remained robust even under strong speech enhancement conditions, outperforming traditional methods. A user study confirmed that RoVo preserves both naturalness and usability of protected speech, highlighting its effectiveness in complex and evolving threat scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。