arXiv:2605.24614cs.CLcs.AI2026-05中稿 · EMNLP被引 1

提出激活补丁量化大模型遗忘深度,更可靠检测知识是否真正清除。

Measuring the Depth of LLM Unlearning via Activation Patching

论文配图:Measuring the Depth of LLM Unlearning via Activation Patching
图 1 · 摘自论文原文
  • 用激活补丁定位编码目标知识的层,评估遗忘程度。
  • 在150个模型上测试,UDS对遗忘真实性的判断最准确。
  • 适合研究隐私保护与模型安全的学者使用。

大语言模型(LLM)遗忘已成为隐私保护与人工智能安全的关键后处理机制,但审计目标知识是否真正被清除仍具挑战。现有输出级指标无法检测内部表示中残留的知识。近期白盒研究虽揭示了此类残留知识,但常依赖辅助训练或数据集特化方法,缺乏通用性。本文提出遗忘深度评分(UDS),通过激活补丁量化遗忘的机制深度。UDS首先利用保留模型基线识别编码目标知识的层,再在0-1尺度上测量未学习模型中该知识的清除程度。在跨20项指标、150个模型(涵盖8种方法)的元评估中,UDS表现出最高保真度与鲁棒性,证实其因果方法是最可靠的遗忘评估方式。案例研究显示,UDS可发现观测指标因表征迁移而掩盖的残留知识,且清除深度随提示类型变化。我们提供将UDS集成到现有基准框架的指南,并优化评估流程。代码与数据见https://github.com/gnueaj/unlearning-depth-score。

原文摘要 · Abstract (English)

Large language model (LLM) unlearning has emerged as a crucial post-hoc mechanism for privacy protection and AI safety, yet auditing whether target knowledge is truly erased remains challenging. Existing output-level metrics fail to detect when this knowledge remains recoverable from internal representations. Recent white-box studies reveal such residual knowledge but often rely on auxiliary training or dataset-specific adaptations, leaving no generalizable metric. We close this gap with the Unlearning Depth Score (UDS), a metric that quantifies the mechanistic depth of unlearning via activation patching. UDS first identifies layers that encode the target knowledge using a retain model baseline, then measures how much of it is erased in the unlearned model on a 0-1 scale. In a meta-evaluation across 20 metrics on 150 unlearned models spanning 8 methods, UDS achieves the highest faithfulness and robustness, confirming our causal approach as the most reliable for unlearning evaluation. Case studies further show that UDS uncovers residual knowledge obscured from observational metrics by representational shifts, with erasure depth varying across prompt types. We provide guidelines for integrating UDS into existing benchmarking frameworks and streamlining the evaluation pipeline. Code and data are available at https://github.com/gnueaj/unlearning-depth-score.

大模型遗忘评估激活补丁隐私保护

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。