提出新方法缓解大模型删数据时过度遗忘,提升隐私保护与模型性能平衡。
Towards Mitigating Excessive Forgetting in LLM Unlearning via Entanglement-Guidance with Proxy Constraint
- 用样本间语义关联动态调节删数据强度,越相似越重点删
- 多轮追踪特征变化,自动调整遗忘力度避免过度删除
- 无需重训即可提升删数效果,适合实际部署的隐私安全场景
大型语言模型训练数据可能包含隐私或版权内容,随着隐私与所有权问题加剧,数据所有者要求从模型中移除其数据。机器删忆提供了一种无需全量重训即可消除特定数据影响的实用方案。然而,现有方法因缺乏合理的遗忘边界调控机制,常导致过度删忆,造成模型性能无谓下降并增加隐私与鲁棒性风险。本文提出EGUP(基于代理约束的纠缠引导删忆)框架,利用样本间与样本内纠缠机制指导删忆过程,并通过代理约束形成输出预期参考边界,软性规范删忆强度。在每轮迭代中,通过样本间纠缠自适应调整删忆权重,对与保留知识语义更接近的样本施加更强删忆;跨轮次则通过样本内纠缠追踪每个待删样本的表征变化,动态调节删忆力度。该方法兼容现有基于梯度的目标函数,可作为即插即用模块。在TOFU与MUSE基准上评估表明,EGUP在多种大模型上均显著改善了删忆-性能权衡,性能接近重训模型,同时保持可扩展性与鲁棒性。
原文摘要 · Abstract (English)
Large language models (LLMs) are trained on massive datasets that may include private or copyrighted content. Due to growing privacy and ownership concerns, data owners may request the removal of their data from trained models. Machine unlearning provides a practical solution by removing the influence of specific data without full retraining. However, most existing methods still suffer from over-unlearning due to the lack of a principled mechanism to regulate the forgetting boundary, leading to unnecessary utility degradation and heightened privacy and robustness risks. In this work, we propose EGUP (Entanglement-Guided Unlearning with Proxy Constraint), a novel framework that leverages entanglement and proxy constraint to guide the unlearning process while mitigating over-unlearning. Within each iteration, EGUP employs inter-sample entanglement to adaptively reweight the unlearning strength, assigning greater unlearning efforts to forget samples that are semantically closer to retained knowledge. Across iterations, EGUP leverages intra-sample entanglement to track the representation shift of each forget sample and dynamically adjust its unlearning effort. In addition, we incorporate a proxy constraint that approximates the model's expected outputs after unlearning, forming a reference boundary that softly regularizes the unlearning process. EGUP is compatible with existing gradient-based objectives and serves as a plug-and-play enhancement. We evaluate EGUP on the TOFU and MUSE benchmarks, demonstrating consistent improvements in the unlearning-utility trade-off across multiple LLMs. Moreover, EGUP achieves performance close to the retrained model while remaining scalable and robust.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。