提出新方法让多模态模型删数据时既不泄露推理过程,又保住推理能力。
Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
- 通过子空间引导和自适应控制,干预模型内部表示实现精准遗忘
- 在保留推理能力的同时,显著降低推理过程中的信息泄露
- 首个专门评估推理级遗忘与保留的基准,适合安全敏感场景
机器遗忘旨在不重新训练的情况下从已训练模型中删除指定数据。对于具备推理能力的多模态大语言模型(RMLLMs),这一任务尤为困难:即使最终答案被遗忘,中间的思维链步骤仍可能泄露敏感信息,而过度激进的干预会严重损害通用推理能力。然而,目前尚无基准能联合评估遗忘方法在抑制推理级泄露与保持推理能力方面的表现。为此,我们提出了 RMLLMU-Bench,首个针对 RMLLM 遗忘的基准,扩展了标准遗忘指标,增加了对推理泄露和推理保留的专用度量。在该基准上的系统性评估发现,现有用于 MLLMs 和大型(语言)推理模型(LRMs)的遗忘方法要么在推理过程中遗留大量泄露,要么严重削弱推理性能。为解决上述问题,我们提出 R-MUSE(基于子空间引导与自适应控制的推理保全型多模态模型遗忘框架),一种无需训练、仅在推理时干预的方法,能够引导内部表示同时遗忘答案与推理轨迹,同时显式保留通用推理能力。在 RMLLMU-Bench 上的实验表明,R-MUSE 在有效遗忘与推理保留之间实现了显著更优的平衡。
原文摘要 · Abstract (English)
Machine unlearning aims to erase requested data from trained models without full retraining. For Reasoning Multimodal Large Language Models (RMLLMs), this is uniquely challenging: intermediate chain-of-thought steps can still leak sensitive information even when final answers are forgotten, and overly aggressive interventions easily damage general reasoning ability. Yet no benchmark jointly evaluates how well unlearning methods suppress reasoning-level leakage while preserving reasoning competence. We address this gap with RMLLMU-Bench, the first benchmark for RMLLM unlearning that extends standard forgetting metrics with dedicated measures of reasoning leakage and reasoning retention. A systematic evaluation on RMLLMU-Bench reveals that existing unlearning methods for MLLMs and Large (Language) Reasoning Models (LRMs) either leave substantial leakage in the reasoning process or severely degrade reasoning performance. To address these gaps, we propose R-MUSE (Reasoning-preserving MLLM Unlearning via Subspace guidance and Adaptive Steering), a training-free and inference-time intervention framework that steers internal representations to forget both answers and reasoning traces while explicitly preserving general reasoning. Experiments on RMLLMU-Bench demonstrate that R-MUSE achieves a substantially better balance between effective forgetting and reasoning retention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。