通过注入异常数据主动强化模型,防御联邦学习中的后门攻击。
TrojanDam: Detection-Free Backdoor Defense in Federated Learning through Proactive Model Robustification utilizing OOD Data
- 用分布外样本激活冗余神经元,提前防范后门。
- 在多种联邦学习场景下,防御效果优于现有主流方法。
- 无需检测恶意更新,适合实时性要求高的系统。
联邦学习(FL)允许分散的数据持有客户端通过上传本地训练更新至中心服务器,共同训练全局模型。去中心化特性使攻击者可设计精心构造的后门更新,仅在遇到特定触发器时导致全局模型误判。现有防御机制多依赖接收更新后的事后检测,但难以识别与良性更新统计上接近的恶意更新,且在不同训练阶段表现不稳定。未过滤的后门更新会累积至全局模型并最终生效。鉴于无法排除所有后门更新,我们提出一种主动强化全局模型鲁棒性的后门防御范式。首先揭示,后门攻击成功源于恶意与良性更新在模型冗余神经元上缺乏冲突。进一步证明,在集中式环境下利用分布外(OOD)样本激活冗余神经元的可行性,并将其迁移至联邦学习场景,提出新防御机制 TrojanDam。该机制由服务器持续注入新的 OOD 映射至全局模型,激活冗余神经元,从而在聚合过程中抵消后门更新的影响。系统性实验证明,TrojanDam 在多种联邦学习设置下均显著优于多个 SOTA 后门防御方法。
原文摘要 · Abstract (English)
Federated learning (FL) systems allow decentralized data-owning clients to jointly train a global model through uploading their locally trained updates to a centralized server. The property of decentralization enables adversaries to craft carefully designed backdoor updates to make the global model misclassify only when encountering adversary-chosen triggers. Existing defense mechanisms mainly rely on post-training detection after receiving updates. These methods either fail to identify updates which are deliberately fabricated statistically close to benign ones, or show inconsistent performance in different FL training stages. The effect of unfiltered backdoor updates will accumulate in the global model, and eventually become functional. Given the difficulty of ruling out every backdoor update, we propose a backdoor defense paradigm, which focuses on proactive robustification on the global model against potential backdoor attacks. We first reveal that the successful launching of backdoor attacks in FL stems from the lack of conflict between malicious and benign updates on redundant neurons of ML models. We proceed to prove the feasibility of activating redundant neurons utilizing out-of-distribution (OOD) samples in centralized settings, and migrating to FL settings to propose a novel backdoor defense mechanism, TrojanDam. The proposed mechanism has the FL server continuously inject fresh OOD mappings into the global model to activate redundant neurons, canceling the effect of backdoor updates during aggregation. We conduct systematic and extensive experiments to illustrate the superior performance of TrojanDam, over several SOTA backdoor defense methods across a wide range of FL settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。