arXiv:2509.20230cs.LGcs.AI2025-09被引 2

提出新方法让大模型真正遗忘,防住恶意复原攻击

Beyond Sharp Minima: Robust LLM Unlearning via Feedback-Guided Multi-Point Optimization

  • 通过多点反馈优化,避开参数空间中的不稳区域
  • 在两个基准测试中显著提升抗重学攻击能力
  • 适合需要安全删除敏感信息的模型应用

当前大模型遗忘方法存在严重安全漏洞:看似已删除敏感或有害知识,实则可通过少量微调样本快速恢复。我们发现根源在于传统方法在单个数据点上优化遗忘损失,使模型参数陷入损失曲面的尖锐极小值区域。这些不稳定区域对微小参数扰动极度敏感,导致重学攻击可沿陡峭梯度迅速重构被“删除”的知识。为此,我们提出StableUN,一种双层反馈引导的优化框架,通过邻域感知优化主动寻找更稳定的参数区域。该方法融合对抗扰动生成的遗忘反馈与保留模型能力的记忆反馈,利用梯度投影实现双重目标对齐。在WMDP和MUSE基准上的实验表明,该方法在保持良好性能的同时,显著增强了对抗重学攻击和越狱攻击的鲁棒性。

原文摘要 · Abstract (English)

Current LLM unlearning methods face a critical security vulnerability that undermines their fundamental purpose: while they appear to successfully remove sensitive or harmful knowledge, this ``forgotten" information remains precariously recoverable through relearning attacks. We identify that the root cause is that conventional methods optimizing the forgetting loss at individual data points will drive model parameters toward sharp minima in the loss landscape. In these unstable regions, even minimal parameter perturbations can drastically alter the model's behaviors. Consequently, relearning attacks exploit this vulnerability by using just a few fine-tuning samples to navigate the steep gradients surrounding these unstable regions, thereby rapidly recovering knowledge that was supposedly erased. This exposes a critical robustness gap between apparent unlearning and actual knowledge removal. To address this issue, we propose StableUN, a bi-level feedback-guided optimization framework that explicitly seeks more stable parameter regions via neighborhood-aware optimization. It integrates forgetting feedback, which uses adversarial perturbations to probe parameter neighborhoods, with remembering feedback to preserve model utility, aligning the two objectives through gradient projection. Experiments on WMDP and MUSE benchmarks demonstrate that our method is significantly more robust against both relearning and jailbreaking attacks while maintaining competitive utility performance.

大模型遗忘安全鲁棒性参数优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。