无需保留数据,用推理机制实现大模型实时遗忘。
DRAGON: Guard LLM Unlearning in Context via Negative Detection and Reasoning
- 利用上下文思维链指令构建轻量检测模块,识别需遗忘的输入。
- 通过专用推理模型在不修改模型的前提下实现安全干预。
- 适合部署后保护隐私、无需训练数据的实用场景。
大型语言模型中的遗忘技术对保护隐私数据和清除有害知识至关重要。现有方法多依赖微调,在需要保留数据的实际场景中难以应用。为此,我们提出DRAGON框架,基于推理的系统性方法,利用上下文思维链(CoT)指令在推理前守护已部署的LLM。该方法不修改基础模型,而是利用模型固有的指令遵循能力,引入轻量级检测模块识别需遗忘的提示,再通过专用的CoT防护模型进行上下文干预。为评估遗忘性能,我们提出新指标用于遗忘效果与持续遗忘设置。在三个代表性任务上的实验证明,DRAGON具备强遗忘能力、可扩展性及实际应用价值。
原文摘要 · Abstract (English)
Unlearning in Large Language Models (LLMs) is crucial for protecting private data and removing harmful knowledge. Most existing approaches rely on fine-tuning to balance unlearning efficiency with general language capabilities. However, these methods typically require training or access to retain data, which is often unavailable in real world scenarios. Although these methods can perform well when both forget and retain data are available, few works have demonstrated equivalent capability in more practical, data-limited scenarios. To overcome these limitations, we propose Detect-Reasoning Augmented GeneratiON (DRAGON), a systematic, reasoning-based framework that utilizes in-context chain-of-thought (CoT) instructions to guard deployed LLMs before inference. Instead of modifying the base model, DRAGON leverages the inherent instruction-following ability of LLMs and introduces a lightweight detection module to identify forget-worthy prompts without any retain data. These are then routed through a dedicated CoT guard model to enforce safe and accurate in-context intervention. To robustly evaluate unlearning performance, we introduce novel metrics for unlearning performance and the continual unlearning setting. Extensive experiments across three representative unlearning tasks validate the effectiveness of DRAGON, demonstrating its strong unlearning capability, scalability, and applicability in practical scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。