arXiv:2510.16629cs.LG2025-10被引 4

多阶段训练让模型遗忘无法完全还原,路径依赖导致效果不可控。

On the Impossibility of Retrain Equivalence in Machine Unlearning

  • 局部遗忘方法仅用遗忘数据梯度,但结果受训练顺序影响。
  • 不同训练顺序下模型遗忘后准确率下降超20%,行为差异显著。
  • 适合关注大模型隐私与可解释性的研究者参考。

机器遗忘旨在移除特定训练数据对模型输出的影响。理想目标是重训练等价性——即模型行为与仅用保留数据从头训练的结果一致。该目标最初针对独立同分布数据批次建模,但现代训练流程常涉及多阶段训练,各阶段数据分布与目标不同,如大语言模型的对齐、推理能力优化等。本文通过理论与实验表明,这种多阶段训练引入了机器遗忘的根本障碍。理论显示,局部遗忘(仅使用遗忘集梯度的方法)的结果具有路径依赖性:模型在遗忘过程中的表现受训练阶段顺序影响,因此无路径依赖算法无法普遍实现重训练等价性。我们在Llama和Qwen模型(1B至14B)上实证了该现象,采用梯度上升、NPO与SimNPO等局部遗忘算法,在不同训练顺序下模型遗忘后行为分化,GSM8K准确率下降幅度相差超过20%。部分学习路径始终导致遗忘缓慢。遗忘过程中概率质量倾向于压缩为改写或替代概念,也呈现路径依赖。这些结果一致表明,只要模型分阶段训练,重训练等价性对局部遗忘算法而言就是病态目标。当难以获取训练历史时,当前工作呼吁重新思考机器遗忘的定义与期望标准。

原文摘要 · Abstract (English)

Machine unlearning seeks to selectively remove the "influence" of specific training data on a model's outputs. The ideal goal is Retrain Equivalence--behavior identical to a model trained from scratch on only the retained data. This goal was formulated for models trained on i.i.d. data batches, but modern pipelines often involve multi-stage training, with each stage having a distinct data distribution and objective. Examples include LLM fine-tuning for alignment, reasoning ability, etc. Our study shows via theory and experiments that this shift to multi-stage training introduces a fundamental barrier for machine unlearning. The theory indicates that the outcome of local unlearning--methods that only use gradients computed on the forget set--is path-dependent. That is, a model's behavior during unlearning is influenced by the order of its training stages during learning, making it impossible for path-oblivious algorithms to universally achieve Retrain Equivalence. We empirically demonstrate the same phenomenon in LLM post-training across Llama and Qwen models (1B to 14B) with gradient ascent, NPO, and SimNPO local unlearning algorithms. Models fine-tuned via different orderings of identical training stages diverge in behavior during unlearning, with the degradation in GSM8K accuracy after unlearning varying by over 20% across paths. We also observe that some learning paths consistently produce models that unlearn slowly. During unlearning, whether the probability mass gets squeezed into paraphrasing or alternative concepts is also path-dependent. These results consistently show that Retrain Equivalence is an ill-posed target for local unlearning algorithms, so long as the target models are trained in stages. In situations where access to models' training histories is hard, the current work calls for rethinking the definition and desiderata of machine unlearning.

机器遗忘大模型路径依赖隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。