通过不可逆投影清除大模型有害信息,防止知识复现。
Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
- 在模型隐藏层施加不可逆投影,彻底消除有害信息痕迹。
- 实验显示可持续有效删去有害数据,且性能不受影响。
- 适合关注模型安全与可控性研究者使用。
大型语言模型在多个领域表现出色,但其潜在的安全隐患日益突出。由于模型可能内存储存不安全知识,机器退学成为保障模型安全的重要范式。现有方法如梯度上升和负偏好优化仅通过参数化训练抑制不良数据激活,未能完全清除模型内的信息痕迹,导致难以实现有效的持续退学,并易受重学攻击。为此,本文提出一种全新的不可逆投影机制——形态转化表示投影(Metamorphosis Representation Projection, MRP),首次将不可逆投影特性应用于机器退学。该方法在特定网络层的隐藏状态空间中实施投影变换,有效消除有害信息同时保留有用知识。实验表明,该方法可实现高效连续退学,成功抵御重学攻击,在退学效果上达到当前最优水平,且自然性能保持良好。代码已开源。
原文摘要 · Abstract (English)
While Large Language Models (LLMs) have demonstrated impressive performance in various domains and tasks, concerns about their safety are becoming increasingly severe. In particular, since models may store unsafe knowledge internally, machine unlearning has emerged as a representative paradigm to ensure model safety. Existing approaches employ various training techniques, such as gradient ascent and negative preference optimization, in attempts to eliminate the influence of undesired data on target models. However, these methods merely suppress the activation of undesired data through parametric training without completely eradicating its informational traces within the model. This fundamental limitation makes it difficult to achieve effective continuous unlearning, rendering these methods vulnerable to relearning attacks. To overcome these challenges, we propose a Metamorphosis Representation Projection (MRP) approach that pioneers the application of irreversible projection properties to machine unlearning. By implementing projective transformations in the hidden state space of specific network layers, our method effectively eliminates harmful information while preserving useful knowledge. Experimental results demonstrate that our approach enables effective continuous unlearning and successfully defends against relearning attacks, achieving state-of-the-art performance in unlearning effectiveness while preserving natural performance. Our code is available in https://github.com/ChengcanWu/MRP.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。