让大模型遗忘更可靠:突破表达形式依赖,实现真正有效的知识清除
LLM Unlearning Should Be Form-Independent
- 针对知识表达形式变化导致遗忘失效的问题,提出形式无关的遗忘新思路
- 新基准ORT验证现有方法在不同表达下普遍失效,问题广泛且严重
- 无需训练的ROCR方法可秒级重定向危险概念,效果显著且输出自然
大语言模型(LLM)遗忘旨在消除模型中的有害或隐私知识,对防止滥用具有重要意义。然而,现有方法在真实场景中表现不佳,主要原因是其有效性高度依赖训练样本的表达形式,难以泛化到同一知识的不同表述。本文首次系统定义该问题为‘形式依赖偏差’,并构建全新基准ORT以量化评估遗忘方法对知识表达变化的鲁棒性。实验表明,当前主流方法普遍存在严重的形式依赖问题。为此,我们提出无需训练的秩一概念重定向(ROCR)方法,通过识别下游任务中的不变危险概念进行精准干预,可在数秒内将特定目标概念重定向至无害概念。大量实验证明,ROCR显著优于传统方法,在保持输出自然性的同时大幅提升遗忘效果。
原文摘要 · Abstract (English)
Large Language Model (LLM) unlearning aims to erase or suppress undesirable knowledge within the model, offering promise for controlling harmful or private information to prevent misuse. However, recent studies highlight its limited efficacy in real-world scenarios, hindering practical adoption. In this study, we identify a pervasive issue underlying many downstream failures: the effectiveness of existing unlearning methods heavily depends on the form of training samples and frequently fails to generalize to alternate expressions of the same knowledge. We formally characterize this problem as Form-Dependent Bias and systematically investigate its specific manifestation patterns across various downstream tasks. To quantify its prevalence and support future research, we introduce ORT, a novel benchmark designed to evaluate the robustness of unlearning methods against variations in knowledge expression. Results reveal that Form-Dependent Bias is both widespread and severe among current techniques. We argue that LLM unlearning should be form-independent to address the endless forms of downstream tasks encountered in real-world security-critical scenarios. Towards this goal, we introduce Rank-one Concept Redirection (ROCR), a novel training-free method, as a promising solution path. ROCR performs unlearning by targeting the invariants in downstream tasks, specifically the activated dangerous concepts. It is capable of modifying model parameters within seconds to redirect the model's perception of a specific unlearning target concept to another harmless concept. Extensive experiments demonstrate that ROCR significantly improves unlearning effectiveness compared to traditional methods while generating highly natural outputs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。