arXiv:2502.10329cs.SDcs.CR2025-02被引 3

用不可听的伪音色干扰,防深度伪造语音克隆

VocalCrypt: Novel Active Defense Against Deepfake Voice Based on Masking Effect

  • 在音频中嵌入人耳不可闻的伪音色干扰信号
  • 生成速度提升500%,防御效果优于传统方法
  • 主动防御,适合语音保护场景

AI语音克隆技术快速发展,推动了文本转语音(TTS)和语音转换(VC)的进步,但也带来滥用风险,造成经济损失和负面舆论。为应对这一挑战,本文提出一种新型主动防御方法VocalCrypt,基于频谱掩蔽效应(SFS)在音频片段中嵌入人耳不可闻的伪音色(干扰信息),形成系统性干扰片段,实现语音保护而不影响音质。相比现有方法如对抗噪声,VocalCrypt显著提升鲁棒性和实时性能,生成速度提升500%的同时保持有效干扰。不同于仅用于事后检测的音频水印技术,本方法提供事前防御,降低部署成本,提升可行性。在Zhvoice和VCTK Corpus数据集上的大量实验表明,该系统在自动说话人验证(ASV)测试中表现优异,同时保障受保护音频的完整性。

原文摘要 · Abstract (English)

The rapid advancements in AI voice cloning, fueled by machine learning, have significantly impacted text-to-speech (TTS) and voice conversion (VC) fields. While these developments have led to notable progress, they have also raised concerns about the misuse of AI VC technology, causing economic losses and negative public perceptions. To address this challenge, this study focuses on creating active defense mechanisms against AI VC systems. We propose a novel active defense method, VocalCrypt, which embeds pseudo-timbre (jamming information) based on SFS into audio segments that are imperceptible to the human ear, thereby forming systematic fragments to prevent voice cloning. This approach protects the voice without compromising its quality. In comparison to existing methods, such as adversarial noise incorporation, VocalCrypt significantly enhances robustness and real-time performance, achieving a 500\% increase in generation speed while maintaining interference effectiveness. Unlike audio watermarking techniques, which focus on post-detection, our method offers preemptive defense, reducing implementation costs and enhancing feasibility. Extensive experiments using the Zhvoice and VCTK Corpus datasets show that our AI-cloned speech defense system performs excellently in automatic speaker verification (ASV) tests while preserving the integrity of the protected audio.

语音安全深度伪造主动防御音频干扰

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。