通过反向操作特征空间中的后门方向,实现在推理时高效修复被植入后门的模型。
Kill it with FIRE: On Leveraging Latent Space Directions for Runtime Backdoor Mitigation in Deep Neural Networks
- 在推理阶段逆向操作模型内部特征空间中的后门方向,实现无须重训练的修复。
- 在多个图像数据集和网络架构上,对各类攻击的防御准确率均显著优于现有方法。
- 计算开销极低,适合已部署模型的实时后门检测与修复场景。
机器学习模型日益广泛应用于日常生活,也成为攻击者操纵系统的靶点。其中一种常见威胁是通过污染训练数据或恶意训练过程植入后门,使得输入特定触发器时模型产生非预期行为。现有缓解方法包括过滤训练数据、修改模型或对输入进行昂贵的预处理;但若模型已部署,则这些策略往往无效或低效。为此,我们提出一种推理时后门缓解方法FIRE(Feature-space Inference-time REpair)。我们假设触发器会在模型内部表示中引发结构化且可重复的变化,将其视为层间特征空间中的方向,并可反向应用以修正推理过程。因此,FIRE通过操纵特征表示,将受污染样本的特征沿后门方向反向移动,从而消除触发器影响。评估表明,FIRE计算开销小,在多个图像基准测试中对不同攻击、数据集和网络架构均优于现有推理时缓解方案。
原文摘要 · Abstract (English)
Machine learning models are increasingly present in our everyday lives; as a result, they become targets of adversarial attackers seeking to manipulate the systems we interact with. A well-known vulnerability is a backdoor introduced into a neural network by poisoned training data or a malicious training process. Backdoors can be used to induce unwanted behavior by including a certain trigger in the input. Existing mitigations filter training data, modify the model, or perform expensive input modifications on samples. If a vulnerable model has already been deployed, however, those strategies are either ineffective or inefficient. To address this gap, we propose our inference-time backdoor mitigation approach called FIRE (Feature-space Inference-time REpair). We hypothesize that a trigger induces structured and repeatable changes in the model's internal representation. We view the trigger as directions in the latent spaces between layers that can be applied in reverse to correct the inference mechanism. Therefore, we turn the backdoored model against itself by manipulating its latent representations and moving a poisoned sample's features along the backdoor directions to neutralize the trigger. Our evaluation shows that FIRE has low computational overhead and outperforms current runtime mitigations on image benchmarks across various attacks, datasets, and network architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。