实时持续遗忘,不改模型也能精准删知识
CURaTE: Continual Unlearning in Real Time with Ensured Preservation of LLM Knowledge

- 用句子嵌入模型判断输入是否匹配删除请求
- 遗忘效果优于现有方法,且可无限次更新
- 无需修改模型参数,适合实际部署场景
由于无法在预训练前完全过滤潜在敏感数据,大语言模型需在训练后删除特定知识。现有方法缺乏实时连续性,导致性能下降和敏感信息暴露时间延长。为此,我们提出实时持续遗忘并确保知识保留的CURaTE方法。该方法首先在设计的数据集上训练句子嵌入模型,以形成清晰的决策边界,判断输入提示是否对应已存储的遗忘请求。通过计算输入与遗忘请求的相似度,决定返回答案或拒绝响应。实验表明,即使采用此简单策略,CURaTE不仅遗忘效果优于现有方法,且因不修改模型参数,可在任意次数更新下保持近乎完美的知识保留,并唯一实现真正的实时持续遗忘。
原文摘要 · Abstract (English)
The inability to filter out in advance all potentially problematic data from the pre-training of large language models has given rise to the need for methods for unlearning specific pieces of knowledge after training. Existing techniques overlook the need for continuous and immediate action, causing them to suffer from degraded utility as updates accumulate and protracted exposure of sensitive information. To address these issues, we propose Continual Unlearning in Real Time with Ensured Preservation of LLM Knowledge (CURaTE). Our method begins by training a sentence embedding model on a dataset designed to enable the formation of sharp decision boundaries for determining whether a given input prompt corresponds to any stored forget requests. The similarity of a given input to the forget requests is then used to determine whether to answer or return a refusal response. We show that even with such a simple approach, not only does CURaTE achieve more effective forgetting than existing methods, but by avoiding modification of the language model parameters, it also maintains near perfect knowledge preservation over any number of updates and is the only method capable of continual unlearning in real-time.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。