提出FUPareto框架,解决联邦遗忘中遗忘与性能的矛盾问题。
FUPareto: Bridging the Forgetting-Utility Gap in Federated Unlearning via Pareto Augmented Optimization
- 采用帕累托优化,分阶段实现遗忘与性能保留
- 多客户端并发遗忘时仍保持高效且性能损失小
- 适合需隐私保护与模型持续更新的场景
联邦遗忘(FU)旨在高效移除特定客户端数据对联邦模型的影响,同时保持其余客户端的模型性能。现有方法面临三大挑战:(1)遗忘目标常牺牲模型性能或增加成员推断攻击风险;(2)遗忘与性能之间存在固有冲突,过度遗忘必然损害保留性能;(3)多客户端并发遗忘支持差,客户端间梯度冲突降低遗忘质量。为此,我们提出FUPareto,一种基于帕累托增强优化的高效遗忘框架。引入最小边界偏移(MBS)损失,通过将目标类别得分压至非目标类最高得分以下,实现更高效的遗忘并缓解成员推断攻击风险。在遗忘过程中,FUPareto执行帕累托改进以维持性能,进行帕累托扩展以确保遗忘效果。其中,帕累托扩展阶段采用空空间投影多梯度下降算法(MGDA),解耦客户端间梯度冲突,实现多个客户端公平、高效、并发遗忘,同时最小化性能退化。在多种场景下的大量实验表明,FUPareto在遗忘效果和保留性能上均优于当前最先进的联邦遗忘方法。
原文摘要 · Abstract (English)
Federated Unlearning (FU) aims to efficiently remove the influence of specific client data from a federated model while preserving utility for the remaining clients. However, three key challenges remain: (1) existing unlearning objectives often compromise model utility or increase vulnerability to Membership Inference Attacks (MIA); (2) there is a persistent conflict between forgetting and utility, where further unlearning inevitably harms retained performance; and (3) support for concurrent multi-client unlearning is poor, as gradient conflicts among clients degrade the quality of forgetting. To address these issues, we propose FUPareto, an efficient unlearning framework via Pareto-augmented optimization. We first introduce the Minimum Boundary Shift (MBS) Loss, which enforces unlearning by suppressing the target class logit below the highest non-target class logit; this can improve the unlearning efficiency and mitigate MIA risks. During the unlearning process, FUPareto performs Pareto improvement steps to preserve model utility and executes Pareto expansion to guarantee forgetting. Specifically, during Pareto expansion, the framework integrates a Null-Space Projected Multiple Gradient Descent Algorithm (MGDA) to decouple gradient conflicts. This enables effective, fair, and concurrent unlearning for multiple clients while minimizing utility degradation. Extensive experiments across diverse scenarios demonstrate that FUPareto consistently outperforms state-of-the-art FU methods in both unlearning efficacy and retained utility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。