提出边缘校准方法,让大模型在被重学攻击后仍能保持遗忘效果。
Crossing the Margin Cliff: Toward Relearn-Robust LLM Unlearning via Margin Calibration

- 通过校准每标记的置信度边缘,对抗重学攻击导致的遗忘失效
- 在多个数据集和模型上,重学后遗忘指标提升至0.18(原0.41)
- 无需微调参考模型,适合实际部署场景
大型语言模型在重学攻击下普遍缺乏鲁棒性。在TOFU数据集上,对20个遗忘样本微调后,所有评估方法均显著恢复了遗忘集的ROUGE分数。我们发现这一脆弱性源于优化几何结构:14种后处理方法的单标记答案边缘在42个实验组中的41组中收敛于保留参考值上方的一个狭窄区间,称为‘边缘悬崖’。我们证明,只要保留耦合使遗忘内容的诊断对数几率高于某一阈值,该悬崖就会出现,而这种条件在34个实验组中已被直接验证。提出的边距校准(MC)方法通过引入非饱和边距铰链和独立指令语料的KL探测器,在原始损失饱和处重新施加遗忘压力。在梯度主导条件下,其稳定解位于悬崖跨越侧,给出重学边际提升的上限。在三个Llama-3尺寸、三个遗忘层级的TOFU,MUSE-News on Llama-2-7B-hf,以及Phi-3.5面板上,单一冻结配置在全部14个对比任务和所有重学实验组中胜出(平均重学后ROUGE-L从0.41降至0.18),13/14项任务的成员身份AUC降低,主要代价为保留性能小幅下降。
原文摘要 · Abstract (English)
Large language model unlearning is consistently fragile under relearn attacks. On TOFU, fine-tuning on twenty forget examples substantially recovers held-out forget-set ROUGE for every method we evaluate, and we trace this fragility to optimization geometry. The per-token answer margin of fourteen post-hoc methods spanning gradient, preference, and distillation families converges into a narrow band above the retain reference in 41 of 42 method--size cells, a regularity we call the margin cliff. We prove that this cliff follows whenever the retain coupling holds the diagnostic log-odds of forget content above a floor, a condition that token-saturating losses induce at stationarity and that we verify directly on 34 of 42 cells. Margin Calibration (\textsc{MC}) is a plug-in polish adding a non-saturating margin hinge anchored at the reference's per-token margin plus a KL probe on a disjoint instruction corpus, restoring forget-side pressure where the native loss saturates. Under a stated gradient-dominance condition, whose on-trajectory gradient signature we measure by instrumenting the polish, its stationary set lies on the cliff-crossing side, yielding an attack-budget upper bound on the relearn margin lift. Across TOFU (three Llama-3 sizes, three forget tiers), MUSE-News on Llama-2-7B-hf, and a Phi-3.5 panel, a single frozen configuration wins all 14 head-to-head forget aggregates and all populated relearn cells (panel-mean post-attack ROUGE-L $0.41$ to $0.18$) and lowers raw membership AUC on 13/14, with reduced retain-side utility as the main cost. A deployment variant matches these gains without a retain-trained reference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。