arXiv:2608.01008cs.AI2026-08

让多模态大模型精准删除特定属性信息,不伤及无关数据。

Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models

论文配图:Toward Fine-Grained Forgetting:Attribute Unlearning for Multimodal Large Language Models
图 1 · 摘自论文原文
  • 通过激活位置定位关键层,精准识别需遗忘属性的触发点。
  • 在多个模型上实现90%以上属性遗忘率,同时保留95%以上非敏感信息。
  • 适合需要精细隐私保护的多模态应用,如医疗影像与身份管理。

多模态大语言模型(MLLM)具备强大的视觉-语言能力,但也可能记忆并泄露敏感信息。机器遗忘旨在不重新训练的前提下移除指定知识,同时保持通用能力。现有隐私基准主要采用身份级删除,但实际需求更细粒度:模型应遗忘特定属性,同时保留同一身份的非敏感信息。为此,我们提出属性级MLLM遗忘任务,并构建涵盖长文本、数值、短文本目标,多种遗忘比例和多样问题类型的基准。评估发现,目标属性与保留属性共享身份特异性及视觉证据,导致选择性遗忘易出现残留泄漏或附带退化;现有方法在此设置下表现不稳定。为此,我们提出因果定位与保留感知投影(CLRP),一种轻量级无训练框架。CLRP通过激活修补识别因果介导目标属性披露的层,再实施保留感知投影,移除目标属性子空间的同时保留同一身份证据。在多种架构和参数规模的主流MLLM上实验表明,CLRP有效提升了遗忘性能。

原文摘要 · Abstract (English)

Multimodal large language models (MLLMs) exhibit strong vision--language capabilities but may also memorize and disclose sensitive information. Machine unlearning seeks to remove designated knowledge without retraining from scratch while preserving general utility. Existing privacy-oriented benchmarks primarily adopt profile-level deletion, whereas practical requests are often finer grained: a model should forget a specified attribute while retaining non-sensitive information about the same identity. We therefore introduce attribute-level MLLM unlearning as a finer-grained task and construct a benchmark spanning long-text, numeric, and short-text targets, multiple forget ratios, and diverse question types. Our evaluation reveals that target and retained attributes share identity-specific and visual evidence, making selective forgetting susceptible to residual leakage or collateral degradation; accordingly, existing methods exhibit unstable forgetting--retention trade-offs in this setting. To address this challenge, we propose Causal Localization and Retain-Aware Projection (CLRP), a lightweight training-free framework. CLRP uses activation patching to identify the layer that causally mediates target-attribute disclosure, then applies a retain-aware projection that removes the target-attribute subspace while preserving same-identity evidence. Experiments across multiple widely used MLLMs with distinct architectures and parameter scales demonstrate the effectiveness of CLRP.

多模态隐私保护遗忘学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。