arXiv:2502.15082cs.LGcs.AI2025-02被引 7

提出UPCORE框架,精准删数据不伤模型性能。

UPCORE: Utility-Preserving Coreset Selection for Balanced Unlearning

  • 基于表示方差筛选遗忘集,剔除异常点减少损伤
  • 三种方法上均提升删除效果与模型保留平衡
  • 适合需合规删数据又怕模型变弱的场景

用户需求或法律框架常要求从预训练模型(包括大语言模型)中移除特定数据。这需要对已训练模型进行数据删除或“遗忘”,但通常会导致模型在其他数据上的性能下降。因此,必须在信息清除与模型能力保留之间取得平衡,否则可能造成删除失败或模型不可用。为此,我们提出UPCORE(效用保持核心集选择)——一种与方法无关的数据选择框架,以缓解遗忘过程中的附带损害。发现模型损伤与遗忘集上模型表示的方差相关,故选择性地修剪遗忘集,剔除异常点,从而最小化遗忘后的模型退化。在三种标准遗忘方法上,UPCORE始终实现删除有效性与模型保留之间的更优平衡。为更好评估该权衡,我们引入新指标:在标准指标上的曲线下面积(AUC)。结果表明,UPCORE同时提升标准指标与AUC,得益于核心集与修剪点间的正向迁移,以及减少了遗忘集对外部点的负向迁移。

原文摘要 · Abstract (English)

User specifications or legal frameworks often require information to be removed from pretrained models, including large language models (LLMs). This requires deleting or "forgetting" a set of data points from an already-trained model, which typically degrades its performance on other data points. Thus, a balance must be struck between removing information and keeping the model's other abilities intact, with a failure to balance this trade-off leading to poor deletion or an unusable model. To this end, we propose UPCORE (Utility-Preserving Coreset Selection), a method-agnostic data selection framework for mitigating collateral damage during unlearning. Finding that the model damage is correlated with the variance of the model's representations on the forget set, we selectively prune the forget set to remove outliers, thereby minimizing model degradation after unlearning. Across three standard unlearning methods, UPCORE consistently achieves a superior balance between the competing objectives of deletion efficacy and model preservation. To better evaluate this trade-off, we introduce a new metric, measuring the area-under-the-curve (AUC) across standard metrics. Our results show that UPCORE improves both standard metrics and AUC, benefiting from positive transfer between the coreset and pruned points while reducing negative transfer from the forget set to points outside of it.

模型遗忘核心集数据删除大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。