arXiv:2502.19982cs.CLcs.LG2025-02ACL被引 3

提出新方法让大模型彻底遗忘知识,连隐含关联信息也能删干净。

Erasing Without Remembering: Implicit Knowledge Forgetting in Large Language Models

  • 通过概率扰动模拟对抗样本,从输出分布中整体降低相关词概率。
  • 在多个数据集上,对原始目标数据遗忘提升50.40%,隐含知识遗忘提升40.73%。
  • 适合关注模型隐私与知识可控删除的研究者和开发者。

本文研究大语言模型中的知识遗忘问题,重点在于泛化遗忘能力——不仅删除特定训练样本,还要消除其逻辑关联的隐含知识。我们识别出更广的遗忘范围,包括改写、主语替换、关系反转及一跳推理的数据。在三个数据集上评估15种主流方法后发现,模型仍能回忆改写答案,并在中间层保留目标事实。为此,我们提出PerMU,一种基于概率扰动的新型遗忘范式。PerMU通过生成对抗性遗忘样本,从logit分布中消除与事实相关的词,整体降低所有答案关联词的概率。实验在TOFU、Harry Potter、ZsRE、WMDP和MUSE等数据集上进行,涵盖1.3B至13B规模模型。结果表明,PerMU在目标数据遗忘上提升50.40%,隐含知识遗忘提升40.73%。代码已公开于https://github.com/MaybeLizzy/PERMU。

原文摘要 · Abstract (English)

In this paper, we investigate knowledge forgetting in large language models with a focus on its generalisation, ensuring that models forget not only specific training samples but also related implicit knowledge. To this end, we begin by identifying a broader unlearning scope that includes both target data and logically associated samples, including rephrased, subject-replaced, relation-reversed, and one-hop reasoned data. We then conduct a rigorous evaluation of 15 state-of-the-art methods across three datasets, revealing that unlearned models still recall paraphrased answers and retain target facts in their intermediate layers. This motivates us to take a preliminary step toward more generalised implicit knowledge forgetting by proposing PerMU, a novel probability perturbation-based unlearning paradigm. PerMU simulates adversarial unlearning samples to eliminate fact-related tokens from the logit distribution, collectively reducing the probabilities of all answer-associated tokens. Experiments are conducted on a diverse range of datasets, including TOFU, Harry Potter, ZsRE, WMDP, and MUSE, using models ranging from 1.3B to 13B in scale. The results demonstrate that PerMU delivers up to a 50.40% improvement in unlearning vanilla target data while maintaining a 40.73% boost in forgetting implicit knowledge. Our code can be found in https://github.com/MaybeLizzy/PERMU.

知识遗忘大模型隐私保护概率扰动

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。