通过检索排除内容修正模型输出,实现高效安全的LLM遗忘
Scalable and Robust LLM Unlearning by Correcting Responses with Retrieved Exclusions
- 用轻量校正器检测输出中的敏感信息并自动修正
- 检索相关被遗忘内容作为上下文参考,无需重新训练
- 在持续遗忘场景下仍保持稳定,适合真实应用
基于网络规模语料训练的语言模型可能记忆并泄露敏感信息,亟需有效的机器遗忘机制。现有方法主要针对输入查询抑制敏感输出,但难以消除底层知识且扩展性差。为此,我们提出纠正式遗忘框架CURE,通过校正器验证模型输出是否含目标知识,并在检测到泄露时进行安全重写。CURE利用轻量校正器对原始模型输出进行验证与修正;为高效处理大规模遗忘请求,它检索与初始响应相关的遗忘目标,并将其作为上下文参考提供给校正器,实现检测与条件重写。借助这一检索增强机制,校正器可无需额外训练即适应新遗忘请求。大量实验表明,CURE显著降低信息泄露,即使在间接查询场景下也优于现有方法,同时保持响应质量与通用能力。此外,其在持续遗忘场景中表现出鲁棒性,具备实际应用潜力。
原文摘要 · Abstract (English)
Language models trained on web-scale corpora risk memorizing and exposing sensitive information, prompting the need for effective machine unlearning. Prior methods mainly focus on input queries to suppress sensitive outputs, yet this often fails to eliminate the underlying knowledge and limits scalability. To address this, we propose Corrective Unlearning with Retrieved Exclusions (CURE), a novel unlearning framework that verifies model outputs for leakage and revises them into safe responses. Specifically, CURE employs a lightweight corrector that is applied to the original model to verify whether outputs contain target knowledge and to rewrite them if any leakage is detected. To efficiently handle large-scale unlearning requests, CURE retrieves unlearning targets that are relevant to the initial response and provides them as in-context references to the corrector for detection and conditional revision. By leveraging this retrieval augmentation, the corrector can adapt to new unlearning requests without additional training. Extensive evaluations demonstrate that CURE substantially reduces information leakage, even from indirect queries where prior works fall short, while maintaining response quality and general utility. Moreover, it demonstrates robustness under continual unlearning scenarios, making it practical for real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。