恶意客户端通过伪装数据请求删除,悄悄植入后门模型。
BadFU: Backdoor Federated Learning through Adversarial Machine Unlearning
- 用伪装样本训练模型,再请求删除它们,触发后门。
- 在多个联邦学习框架中均成功植入后门,攻击隐蔽性强。
- 提醒研究者警惕未验证的删除请求,适合安全方向读者。
联邦学习(FL)作为一种去中心化训练范式,使多个客户端能在不共享本地数据的前提下协作训练共享模型。随着数据隐私和合规性要求的提升,机器遗忘(machine unlearning)——旨在消除特定数据对已训练模型的影响——在联邦设置中变得日益重要,以满足法律、伦理或用户需求。然而,将遗忘机制引入联邦学习带来了新的挑战,并引发大量未被探索的安全风险。特别是,攻击者可能利用遗忘过程破坏全局模型的完整性。本文首次提出联邦遗忘场景下的后门攻击(BadFU),证明攻击者可通过看似合法的遗忘请求,在全局模型中注入后门。具体而言,我们提出一种攻击策略:恶意客户端在联邦训练过程中使用带有后门和伪装样本的数据进行正常训练;当该客户端请求删除伪装样本时,全局模型便转入带后门的状态。在多种联邦学习框架和遗忘策略下的大量实验验证了BadFU的有效性,揭示了当前联邦遗忘实践中的关键漏洞,并强调了构建更安全、鲁棒的联邦遗忘机制的紧迫性。
原文摘要 · Abstract (English)
Federated learning (FL) has been widely adopted as a decentralized training paradigm that enables multiple clients to collaboratively learn a shared model without exposing their local data. As concerns over data privacy and regulatory compliance grow, machine unlearning, which aims to remove the influence of specific data from trained models, has become increasingly important in the federated setting to meet legal, ethical, or user-driven demands. However, integrating unlearning into FL introduces new challenges and raises largely unexplored security risks. In particular, adversaries may exploit the unlearning process to compromise the integrity of the global model. In this paper, we present the first backdoor attack in the context of federated unlearning, demonstrating that an adversary can inject backdoors into the global model through seemingly legitimate unlearning requests. Specifically, we propose BadFU, an attack strategy where a malicious client uses both backdoor and camouflage samples to train the global model normally during the federated training process. Once the client requests unlearning of the camouflage samples, the global model transitions into a backdoored state. Extensive experiments under various FL frameworks and unlearning strategies validate the effectiveness of BadFU, revealing a critical vulnerability in current federated unlearning practices and underscoring the urgent need for more secure and robust federated unlearning mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。