测试大模型真能忘记数据吗?发现标准评估下‘已遗忘’信息仍可被巧妙提示恢复。
Can LLMs Truly Forget? Revealing Unlearning Gaps Through Adversarial Evaluation

- 用对抗性提示测试遗忘效果,揭示干净查询与恶意攻击间的巨大差距。
- 尽管遗忘质量超0.91,仍有72.8%~84.3%的敏感信息可被恢复。
- 提出新评测指标ASR,适合评估模型在恶意提示下的记忆泄露风险。
机器遗忘旨在移除特定训练数据对模型的影响,同时保持其余能力,但评估信息是否真正不可访问仍具挑战。现有基准主要在干净查询下评估遗忘效果,未检验信息在策略性提示下是否仍可恢复。本文基于Llama-3.2-3B-Instruct,在TOFU数据集上统一评估了基于提示和微调的遗忘方法,并对表现优异的方法进行对抗鲁棒性测试。引入攻击成功率(ASR)作为大模型判官指标,衡量对抗响应中泄漏得分超过0.2的比例,覆盖八种攻击方案。结果表明,干净查询下的遗忘与对抗鲁棒性之间存在显著差距:虽有方法遗忘质量达0.91以上,但攻击成功率仍为72.8%~84.3%,接近未保护基线模型的87.5%。而干净多语言重述仅导致2.95%的泄漏。人工审计显示,7/10案例中二元ASR判断与人类事实评估一致,说明ASR是行为可恢复性的有效但不完美信号。研究证实,仅靠标准指标无法确保遗忘后鲁棒性,需引入对抗压力测试作为补充评估手段。
原文摘要 · Abstract (English)
Machine unlearning aims to remove the influence of targeted training data from a model while preserving its remaining capabilities, but evaluating whether such information has truly become inaccessible remains challenging. Existing benchmarks primarily assess unlearning under clean, non-adversarial queries, leaving open whether information that appears forgotten can still be recovered through strategic prompting. We address this gap through a unified evaluation of prompt-based and fine-tuning-based unlearning methods on TOFU using Llama-3.2-3B-Instruct, followed by an adversarial robustness evaluation of methods that perform strongly under standard metrics. We introduce Attack Success Rate (ASR), an LLM-as-judge metric that measures the fraction of adversarial responses whose leakage score exceeds $0.2$, and evaluate recovery across eight attack suites. Our results reveal a substantial gap between clean-query forgetting and adversarial robustness. Although several fine-tuning-based methods achieve Forget Quality above $0.91$, targeted information remains recoverable with ASRs between $72.8\%$ and $84.3\%$, close to the $87.5\%$ ASR of the unprotected base model. In contrast, clean multilingual reformulations yield only $2.95\%$ measured leakage. A manual audit further finds agreement between binary ASR decisions and human factual assessments in seven of ten cases, indicating that ASR provides a useful, though imperfect, signal of behavioral recoverability. These findings show that strong standard-metric performance alone is insufficient to establish robustness after unlearning and motivate adversarial stress-testing as a complementary component of unlearning evaluation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。