用博弈论让模型精准删数据,不丢性能。
MUNBa: Machine Unlearning via Nash Bargaining
- 将遗忘与保留建模为合作博弈,平衡梯度冲突。
- 在图像分类与生成任务中优于现有方法,遗忘更准、泛化更强。
- 适合需合规删数据的AI系统,如医疗、金融场景。
机器遗忘(MU)旨在选择性移除模型中的有害行为,同时保持整体性能。作为多任务学习问题,MU需权衡遗忘特定概念/数据与保留通用性能的目标。直接整合这两类目标易引发梯度冲突与主导问题,阻碍算法收敛至最优解。为此,本文将MU重构为双人合作博弈,两名玩家——遗忘玩家与保留玩家——通过各自的梯度提案,共同最大化整体收益并平衡贡献。受纳什讨价还价理论启发,我们推导出闭式解,引导模型逼近帕累托平稳点。该公式保证均衡解的存在:任何偏离最终状态的行为都会导致双方整体目标下降,确保每项目标均达最优。我们在图像分类与图像生成多个任务上评估算法效果。大量实验使用ResNet、视觉-语言模型CLIP及文本到图像扩散模型表明,本方法优于当前最先进MU算法,在遗忘与保留间实现更优权衡。结果还显示,遗忘精度提升,泛化能力增强,且对对抗攻击更具鲁棒性。
原文摘要 · Abstract (English)
Machine Unlearning (MU) aims to selectively erase harmful behaviors from models while retaining the overall utility of the model. As a multi-task learning problem, MU involves balancing objectives related to forgetting specific concepts/data and preserving general performance. A naive integration of these forgetting and preserving objectives can lead to gradient conflicts and dominance, impeding MU algorithms from reaching optimal solutions. To address the gradient conflict and dominance issue, we reformulate MU as a two-player cooperative game, where the two players, namely, the forgetting player and the preservation player, contribute via their gradient proposals to maximize their overall gain and balance their contributions. To this end, inspired by the Nash bargaining theory, we derive a closed-form solution to guide the model toward the Pareto stationary point. Our formulation of MU guarantees an equilibrium solution, where any deviation from the final state would lead to a reduction in the overall objectives for both players, ensuring optimality in each objective. We evaluate our algorithm's effectiveness on a diverse set of tasks across image classification and image generation. Extensive experiments with ResNet, vision-language model CLIP, and text-to-image diffusion models demonstrate that our method outperforms state-of-the-art MU algorithms, achieving a better trade-off between forgetting and preserving. Our results also highlight improvements in forgetting precision, preservation of generalization, and robustness against adversarial attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。