实时防御语音识别模型的后门攻击,保护自动驾驶语音系统安全。
SpeechGuard: Online Defense against Backdoor Attacks on Speech Recognition Models

- 通过自适应扰动检测并过滤被污染的音频样本
- 结合时频掩码与自编码器实现触发信号抑制和样本净化
- 适用于对安全性要求高的语音交互场景,如智能汽车
后门攻击对神经网络模型构成严重威胁,攻击者可通过操控少量训练数据在训练阶段植入后门。在自动驾驶等安全敏感的语音交互应用中,此类攻击带来重大安全隐患。本文针对语音识别模型提出SpeechGuard,首个运行时在线后门防御框架,可识别并净化被污染的音频样本。具体而言,改进STRIP方法,提出S-STRIP,实现自适应扰动注入以检测并过滤中毒样本;更重要的是,引入时频(T-F)掩码技术,通过自编码器自动生成掩码,抑制触发信号表达,实现样本净化。该两阶段处理机制有效防止模型后门被触发,即使输入含触发信号的语音,仍能准确预测。大量实验表明,SpeechGuard可精准过滤中毒样本,经净化后显著缓解后门威胁,同时保持较高预测准确率。
原文摘要 · Abstract (English)
Backdoor attacks pose a critical threat to neural network models, allowing attackers to implant a backdoor during the training phase by manipulating a small portion of the training data. In security-sensitive applications such as voice interaction for autonomous driving, the presence of backdoor attacks introduces substantial security risks. This study focuses on implementing backdoor defense measures for speech recognition models in run-time, taking into account the characteristics of audio signals. We propose SpeechGuard, the first online backdoor defense pipeline designed to identify and purify poisoned audio samples. Specifically, we improve STRIP method to perform adaptive perturbation injection to detect and filter poisoned samples, named as S-STRIP. More importantly, we further consider the purification of poisoned samples. We utilize time-frequency (T-F) masking to suppress the expression of trigger signals and autonomously generate masks based on an autoencoder. The two-stage processing prevents the backdoor in the model from being triggered, and even input speech carrying triggers can be accurately predicted. Extensive experimental demonstrate that SpeechGuard can accurately filter out poisoned samples. Through purification, it can significantly mitigate the backdoor threat while maintaining a certain prediction accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。