提出新方法实现知识删除的精准控制,避免误删或漏删。
FaithUn: Toward Faithful Forgetting in Language Models by Investigating the Interconnectedness of Knowledge
- 通过识别知识神经元,仅更新相关神经元实现精准遗忘。
- 实验显示现有方法在真实问答场景中无法保证忠实删除。
- 适用于需精确删除敏感信息的语言模型安全应用。
已有研究尝试从语言模型中移除敏感或私密知识以防止泄露,但忽视了知识间的复杂关联性。本文提出‘表面遗忘’概念,指删除方法未能清除应删除的关联知识,或错误删除无关知识。为此,构建新基准 FaithUn,用于评估真实世界知识问答场景下的遗忘忠实性。提出新方法 KLUE,利用可解释性技术识别知识神经元,仅对这些神经元进行更新,并使用未遗忘样本优化。实验表明,主流遗忘方法无法保证忠实删除,而 KLUE 在真实问答任务中表现出显著有效性。
原文摘要 · Abstract (English)
Various studies have attempted to remove sensitive or private knowledge from a language model to prevent its unauthorized exposure. However, prior studies have overlooked the complex and interconnected nature of knowledge, where related knowledge must be carefully examined. Specifically, they have failed to evaluate whether an unlearning method faithfully erases interconnected knowledge that should be removed, retaining knowledge that appears relevant but exists in a completely different context. To resolve this problem, we first define a new concept called superficial unlearning, which refers to the phenomenon where an unlearning method either fails to erase the interconnected knowledge it should remove or unintentionally erases irrelevant knowledge. Based on the definition, we introduce a new benchmark, FaithUn, to analyze and evaluate the faithfulness of unlearning in real-world knowledge QA settings. Furthermore, we propose a novel unlearning method, KLUE, which updates only knowledge-related neurons to achieve faithful unlearning. KLUE identifies knowledge neurons using an explainability method and updates only those neurons using selected unforgotten samples. Experimental results demonstrate that widely-used unlearning methods fail to ensure faithful unlearning, while our method shows significant effectiveness in real-world QA unlearning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。