arXiv:2506.05314cs.CLcs.AI2025-06NeurIPS被引 9

提出新方法让大模型安全删数据,删得干净还不会伤性能。

Constrained Entropic Unlearning: A Primal-Dual Framework for Large Language Models

  • 用约束优化框架分离删与留,强制输出分布均匀化。
  • 在TOFU和MUSE上优于现有方法,删信息不丢保留能力。
  • 无需额外计算开销,适合部署于实际场景的大模型。

在真实应用中,大语言模型越来越需要删除敏感、过时或专有的信息。现有方法通常将遗忘与保留作为正则化的权衡,合并为单一标量损失,常导致优化不稳定且保留数据性能下降,尤其在强遗忘时。本文提出一种新的大模型遗忘约束优化框架:遗忘通过新颖的对数概率边缘平坦化损失实现,显式推动目标遗忘集上的输出分布趋于均匀;保留则通过独立保留集的硬约束保障。相比基于熵的方法,该损失无需softmax,数值稳定且梯度不消失,支持更高效鲁棒的优化。我们采用可扩展的原始-对偶算法求解该问题,通过对偶变量动态揭示遗忘与保留的权衡关系,且无额外计算开销。在多种大模型架构上对TOFU和MUSE基准的评估表明,本方法持续达到或超越当前最优基线,在有效移除目标信息的同时保持下游任务性能。

原文摘要 · Abstract (English)

Large Language Models (LLMs) deployed in real-world settings increasingly face the need to unlearn sensitive, outdated, or proprietary information. Existing unlearning methods typically formulate forgetting and retention as a regularized trade-off, combining both objectives into a single scalarized loss. This often leads to unstable optimization and degraded performance on retained data, especially under aggressive forgetting. We propose a new formulation of LLM unlearning as a constrained optimization problem: forgetting is enforced via a novel logit-margin flattening loss that explicitly drives the output distribution toward uniformity on a designated forget set, while retention is preserved through a hard constraint on a separate retain set. Compared to entropy-based objectives, our loss is softmax-free, numerically stable, and maintains non-vanishing gradients, enabling more efficient and robust optimization. We solve the constrained problem using a scalable primal-dual algorithm that exposes the trade-off between forgetting and retention through the dynamics of the dual variable, all without any extra computational overhead. Evaluations on the TOFU and MUSE benchmarks across diverse LLM architectures demonstrate that our approach consistently matches or exceeds state-of-the-art baselines, effectively removing targeted information while preserving downstream utility.

大模型遗忘学习优化框架

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。