arXiv:2504.05902cs.CRcs.CL2025-04中稿 · ICLR被引 2

通过模块切换提升模型抗后门攻击能力,无需训练数据。

Defending against Backdoor Attacks via Module Switching

  • 采用模块切换机制破坏后门触发路径,无需依赖训练数据。
  • 在少模型场景下优于加权平均法,且在共谋攻击中仍有效。
  • 适用于Transformer与CNN,适合缺乏训练数据的部署场景。

后门攻击严重威胁深度神经网络,使攻击者能在推理阶段植入触发器以诱发隐藏行为。在训练后防御场景中,由于终端用户缺乏训练数据或攻击先验知识,防御尤为困难。模型融合提供了一种低成本解决方案;然而,如加权平均(WAG)等最新方法仅在拥有多个同源模型时表现良好,且对防御者要求较高。本文提出模块切换防御(MSD),用于破坏后门捷径。我们首先在两层网络上验证其理论合理性和实证有效性,结果表明其后门差异度高于WAG,同时保持模型性能。针对深层模型,我们在Transformer和CNN架构上评估了MSD,并设计进化算法优化融合策略,引入选择性机制识别最优组合。实验显示,MSD在实际设置中以更少模型实现更强防御效果,甚至在多模型共谋攻击(部分模型共享相同后门)这一未充分探索情形下,仍表现出优越鲁棒性。代码已开源:https://github.com/weijun-l/module-switching-defense。

原文摘要 · Abstract (English)

Backdoor attacks pose a serious threat to deep neural networks (DNNs), allowing adversaries to implant triggers for hidden behaviors in inference. Defending against such vulnerabilities is especially difficult in the post-training setting, since end-users lack training data or prior knowledge of the attacks. Model merging offers a cost-effective defense; however, latest methods like weight averaging (WAG) provide reasonable protection when multiple homologous models are available, but are less effective with fewer models and place heavy demands on defenders. We propose a module-switching defense (MSD) for disrupting backdoor shortcuts. We first validate its theoretical rationale and empirical effectiveness on two-layer networks, showing its capability of achieving higher backdoor divergence than WAG, and preserving utility. For deep models, we evaluate MSD on Transformer and CNN architectures and design an evolutionary algorithm to optimize fusion strategies with selective mechanisms to identify the most effective combinations. Experiments show that MSD achieves stronger defense with fewer models in practical settings, and even under an underexplored case of collusive attacks among multiple models--where some models share the same backdoors--switching strategies by MSD deliver superior robustness against diverse attacks. Code is available at https://github.com/weijun-l/module-switching-defense.

后门防御模型融合模块切换

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。