提出无语料库下人物知识遗忘的评测基准与轻量级方法
PRMU: A Corpus-Free Benchmark for Person-Centric Knowledge Unlearning in Multimodal Large Language Models

- 构建无需原始数据的多模态模型人物知识遗忘评测框架
- 现有方法在强遗忘下局部性严重退化,易复现知识
- 提出轻量级编辑方法,在遗忘与保真间取得良好平衡
多模态大语言模型(MLLMs)虽具备强大的人物相关知识存储能力,但其知识删除面临真实场景中原始语料不可用的问题。为解决此挑战,本文提出PRMU——一个面向真实人物中心遗忘请求的无语料库评测基准,聚焦自然习得的人物知识,通过文本与视觉探针(包括对抗测试与细粒度局部性分析)评估模型在遗忘目标知识的同时保留相关知识的能力。为进一步推动研究,我们提出相似性门控投影编辑(SGPE),一种轻量级无语料遗忘基线方法,具备知识位移、受保护参数空间编辑与多模态局部性感知控制。在代表性MLLM上的大量实验表明,现有方法在激进遗忘设置下普遍存在遗忘-局部性权衡不佳问题,且易出现多模态知识重激活;而SGPE在目标遗忘、局部性保持与通用多模态效用间表现更优。代码与数据集将开源。
原文摘要 · Abstract (English)
Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in storing and recalling rich person-related knowledge, raising increasing concerns about reliable knowledge removal. However, existing machine unlearning approaches for MLLMs typically assume access to original forget and retain corpora, which are often unavailable in realistic deletion scenarios. To address this limitation, we introduce PRMU, a benchmark for evaluating corpus-free multimodal unlearning under realistic person-centric deletion requests. PRMU focuses on naturally acquired person-related knowledge and evaluates whether models can remove target knowledge while preserving related knowledge through diverse textual and visual probes, including adversarial evaluation and fine-grained locality analysis. To facilitate research in this setting, we further introduce Similarity-Gated Projection Editing (SGPE), a lightweight corpus-free unlearning baseline with knowledge displacement, protected parameter-space editing, and locality-aware multimodal control. Extensive experiments on representative MLLMs reveal that existing unlearning methods often suffer from unfavorable forgetting-locality trade-offs, with significant locality degradation under aggressive forgetting settings, and remain vulnerable to multimodal knowledge reactivation. Meanwhile, SGPE provides a competitive trade-off between target forgetting, locality preservation, and general multimodal utility. We hope PRMU can facilitate future research toward realistic and scalable multimodal machine unlearning. Code and dataset will be released at https://github.com/2231122/PRMU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。