arXiv:2601.22390cs.SDcs.CR2026-01

用频域能量掩码生成语音对抗扰动,隐蔽绕过说话人识别系统。

An Effective Energy Mask-based Adversarial Evasion Attacks against Misclassification in Speaker Recognition Systems

  • 在频域小能量区做能量掩码,降低人类听觉感知干扰。
  • 相比FGSM和iFGSM,PESQ指标提升26.68%,语音质量更接近原声。
  • 适用于研究语音安全或对抗样本防御的工程师与研究人员。

规避攻击对人工智能系统构成重大威胁,利用机器学习模型漏洞绕过检测机制。语音数据(包括深度伪造)在前景产业中的广泛应用目前受限于法律框架不足。对抗攻击方法成为应对此类数据滥用最有效的手段。本文提出一种基于能量掩码的新型对抗扰动方法(MEP),利用功率谱在频域对原始语音进行能量遮蔽,仅在人类听觉模型不敏感的小能量区域施加扰动。实验采用ECAPA-TDNN和ResNet34等先进说话人识别模型,结果表明该方法在音频质量和规避效果上均表现优异。能量掩码有效降低了感知语音质量评估(PESQ)的退化程度,说明即便存在对抗扰动,对听觉感知影响极小。具体而言,相较FGSM和迭代FGSM,MEP在PESQ上的相对性能提升达26.68%。

原文摘要 · Abstract (English)

Evasion attacks pose significant threats to AI systems, exploiting vulnerabilities in machine learning models to bypass detection mechanisms. The widespread use of voice data, including deepfakes, in promising future industries is currently hindered by insufficient legal frameworks. Adversarial attack methods have emerged as the most effective countermeasure against the indiscriminate use of such data. This research introduces masked energy perturbation (MEP), a novel approach using power spectrum for energy masking of original voice data. MEP applies masking to small energy regions in the frequency domain before generating adversarial perturbations, targeting areas less noticeable to the human auditory model. The study primarily employs advanced speaker recognition models, including ECAPA-TDNN and ResNet34, which have shown remarkable performance in speaker verification tasks. The proposed MEP method demonstrated strong performance in both audio quality and evasion effectiveness. The energy masking approach effectively minimizes the perceptual evaluation of speech quality (PESQ) degradation, indicating that minimal perceptual distortion occurs to the human listener despite the adversarial perturbations. Specifically, in the PESQ evaluation, the relative performance of the MEP method was 26.68% when compared to the fast gradient sign method (FGSM) and iterative FGSM.

语音安全对抗攻击说话人识别

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。