通过剪枝关键连接,高效移除恶意客户端对联邦模型的影响。
FedUP: Efficient Pruning-based Federated Unlearning for Model Poisoning Attacks
- 仅用上一轮权重,识别并剪枝恶意客户端导致的异常连接。
- 在50%恶意客户端攻击下仍能将恶意数据准确率降至重训练水平。
- 无需重新训练,速度更快且节省存储,适合高威胁场景使用。
联邦学习易受模型投毒攻击,恶意客户端可上传有害本地权重破坏全局模型。联邦遗忘(FU)作为应对方案,能在不重新训练的前提下移除恶意贡献者的影响。然而,在恶意客户端可能合谋的情况下,传统依赖合作的遗忘机制失效。本文提出轻量级的FedUP算法,通过剪枝被攻击模型中的特定连接来高效消除恶意影响。该方法仅需利用上一轮训练后的客户端权重,识别出在良性与恶意更新间差异最大的高幅值连接并置零,同时保留良性信息。实验在强威胁模型下进行,最多50%客户端为恶意,且具备聚合过程全知能力。在IID与非IID数据、标签翻转与后门攻击下,FedUP均有效降低恶意影响,使恶意数据准确率接近从头重训练的水平,同时保持良性数据性能。相比现有最先进方法,FedUP始终更快、更省存储。
原文摘要 · Abstract (English)
Federated Learning (FL) can be vulnerable to attacks, such as model poisoning, where adversaries send malicious local weights to compromise the global model. Federated Unlearning (FU) is emerging as a solution to address such vulnerabilities by selectively removing the influence of detected malicious contributors on the global model without complete retraining. However, unlike typical FU scenarios where clients are trusted and cooperative, applying FU with malicious and possibly colluding clients is challenging because their collaboration in unlearning their data cannot be assumed. This work presents FedUP, a lightweight FU algorithm designed to efficiently mitigate malicious clients' influence by pruning specific connections within the attacked model. Our approach achieves efficiency by relying only on clients' weights from the last training round before unlearning to identify which connections to inhibit. Isolating malicious influence is non-trivial due to overlapping updates from benign and malicious clients. FedUP addresses this by carefully selecting and zeroing the highest magnitude weights that diverge the most between the latest updates from benign and malicious clients while preserving benign information. FedUP is evaluated under a strong adversarial threat model, where up to 50%-1 of the clients could be malicious and have full knowledge of the aggregation process. We demonstrate the effectiveness, robustness, and efficiency of our solution through experiments across IID and Non-IID data, under label-flipping and backdoor attacks, and by comparing it with state-of-the-art (SOTA) FU solutions. In all scenarios, FedUP reduces malicious influence, lowering accuracy on malicious data to match that of a model retrained from scratch while preserving performance on benign data. FedUP achieves effective unlearning while consistently being faster and saving storage compared to the SOTA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。