通过数据模型匹配实现高效机器遗忘,效果优于现有方法。
Attribute-to-Delete: Machine Unlearning via Datamodel Matching
- 利用数据归因预测删去指定数据后的模型输出,再微调原模型匹配。
- 在非凸场景下仍表现优异,相比已有方法显著提升遗忘效果。
- 可作为通用框架,未来数据归因进步将直接推动遗忘性能提升。
机器遗忘——高效消除少量训练数据对预训练模型的影响——近年来受到广泛关注。然而,现有方法在非凸设置下的严格评估中表现不佳。本文提出一种新方法:数据模型匹配(DMM),其核心思想是使遗忘后模型的输出与从剩余数据重新训练的模型输出在统计上无法区分。具体地,DMM首先使用数据归因技术预测若模型在剔除遗忘集后重新训练的输出;随后微调原模型以匹配这些预测输出。在简单凸设置下,该方法理论上优于多种迭代遗忘算法。实证上,结合现有评估和基于KL散度的新指标,DMM在非凸场景中仍展现出显著优于现有算法的遗忘性能。此外,DMM作为元算法,未来数据归因技术的进步可直接转化为更优的遗忘方案。
原文摘要 · Abstract (English)
Machine unlearning -- efficiently removing the effect of a small "forget set" of training data on a pre-trained machine learning model -- has recently attracted significant research interest. Despite this interest, however, recent work shows that existing machine unlearning techniques do not hold up to thorough evaluation in non-convex settings. In this work, we introduce a new machine unlearning technique that exhibits strong empirical performance even in such challenging settings. Our starting point is the perspective that the goal of unlearning is to produce a model whose outputs are statistically indistinguishable from those of a model re-trained on all but the forget set. This perspective naturally suggests a reduction from the unlearning problem to that of data attribution, where the goal is to predict the effect of changing the training set on a model's outputs. Thus motivated, we propose the following meta-algorithm, which we call Datamodel Matching (DMM): given a trained model, we (a) use data attribution to predict the output of the model if it were re-trained on all but the forget set points; then (b) fine-tune the pre-trained model to match these predicted outputs. In a simple convex setting, we show how this approach provably outperforms a variety of iterative unlearning algorithms. Empirically, we use a combination of existing evaluations and a new metric based on the KL-divergence to show that even in non-convex settings, DMM achieves strong unlearning performance relative to existing algorithms. An added benefit of DMM is that it is a meta-algorithm, in the sense that future advances in data attribution translate directly into better unlearning algorithms, pointing to a clear direction for future progress in unlearning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。