通过梯度大小识别并削弱后门神经元,提升语音识别安全
Gradient Norm-based Fine-Tuning for Backdoor Defense in Automatic Speech Recognition
- 根据后门模型中梯度值差异,定位异常神经元
- 引入梯度范数正则化,使后门响应降低90%以上
- 专为语音领域设计,适合部署在实际语音系统中
后门攻击对深度神经网络的安全构成严重威胁。尽管视觉领域已发展出多种防御手段,但音频领域的专用防御仍为空白,且从视觉迁移的方案效果有限。为此,本文提出基于梯度范数的微调(GN-FT)策略,基于后门模型的观察发现:后门神经元的梯度值显著高于正常神经元,而干净神经元梯度最低。在此基础上,通过引入梯度范数正则化对后门模型进行微调,旨在抑制和减少后门神经元的影响。同时采用近似损失计算以降低实现成本。在两个语音识别数据集(LibriSpeech、ASVspoof2019)上,针对五种不同模型的实验表明,该方法在消除后门攻击方面表现卓越。据我们所知,这是首个专门且有效的音频领域后门防御方法。
原文摘要 · Abstract (English)
Backdoor attacks have posed a significant threat to the security of deep neural networks (DNNs). Despite considerable strides in developing defenses against backdoor attacks in the visual domain, the specialized defenses for the audio domain remain empty. Furthermore, the defenses adapted from the visual to audio domain demonstrate limited effectiveness. To fill this gap, we propose Gradient Norm-based FineTuning (GN-FT), a novel defense strategy against the attacks in the audio domain, based on the observation from the corresponding backdoored models. Specifically, we first empirically find that the backdoored neurons exhibit greater gradient values compared to other neurons, while clean neurons stay the lowest. On this basis, we fine-tune the backdoored model by incorporating the gradient norm regularization, aiming to weaken and reduce the backdoored neurons. We further approximate the loss computation for lower implementation costs. Extensive experiments on two speech recognition datasets across five models demonstrate the superior performance of our proposed method. To the best of our knowledge, this work is the first specialized and effective defense against backdoor attacks in the audio domain.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。