提出可精准删除数据影响的LLM遗忘方法,不伤模型性能
Forgetting-MarI: LLM Unlearning via Marginal Information Regularization
- 通过惩罚边际信息,只删目标数据新增内容
- 实测优于现有方法,遗忘更彻底且性能下降少
- 适合需合规与隐私保护的大型语言模型应用
随着人工智能模型训练数据不断增长,从已训练模型中移除特定数据的影响变得至关重要,以满足隐私保护和法规要求。无监督学习(unlearning)通过选择性消除模型参数知识,无需从头训练,对资源密集型的大语言模型(LLMs)尤为关键。现有方法在尝试‘遗忘’时往往过度删除信息,导致模型性能下降。我们提出 Forgetting-MarI,一种可证明仅移除待遗忘数据所贡献的额外(边际)信息的LLM遗忘框架,同时保留被保留数据支持的信息。通过惩罚边际信息,该方法在训练模型中为待遗忘数据提供残留影响的显式上界,实现可证明的不可检测性。大量实验表明,本方法优于当前最先进方法,在多种基准测试中均实现可靠遗忘并更好保持模型整体性能。这一进展推动了AI系统在不牺牲效能的前提下,更加可控、符合隐私与版权法规。
原文摘要 · Abstract (English)
As AI models are trained on ever-expanding datasets, the ability to remove the influence of specific data from trained models has become essential for privacy protection and regulatory compliance. Unlearning addresses this challenge by selectively removing parametric knowledge from the trained models without retraining from scratch, which is critical for resource-intensive models such as Large Language Models (LLMs). Existing unlearning methods often degrade model performance by removing more information than necessary when attempting to ''forget'' specific data. We introduce Forgetting-MarI, an LLM unlearning framework that provably removes only the additional (marginal) information contributed by the data to be unlearned, while preserving the information supported by the data to be retained. By penalizing marginal information, our method yields an explicit upper bound on the unlearn dataset's residual influence in the trained models, providing provable undetectability. Extensive experiments confirm that our approach outperforms current state-of-the-art unlearning methods, delivering reliable forgetting and better preserved general model performance across diverse benchmarks. This advancement represents an important step toward making AI systems more controllable and compliant with privacy and copyright regulations without compromising their effectiveness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。