arXiv:2605.06096cs.CLcs.CV2026-05

发现视觉语言模型编辑后会混淆实体身份,导致文本查询返回错误信息。

Uncovering Entity Identity Confusion in Multimodal Knowledge Editing

论文配图:Uncovering Entity Identity Confusion in Multimodal Knowledge Editing
图 1 · 摘自论文原文
  • 通过诊断基准揭示编辑后模型误将新实体名当标签,图像仍被认作原实体。
  • 实验显示约60%的编辑案例出现身份混淆,尤其在跨模态查询中更严重。
  • 建议只在图像-实体绑定阶段修改,可显著降低混淆问题,适合模型可解释性研究者。

多模态知识编辑(MKE)旨在部署后修正大型视觉语言模型的内部知识,但编辑后模型的行为模式尚未充分探索。本文识别出一种系统性失效模式:实体身份混淆(EIC),即编辑后的模型对仅含文本的原实体身份查询,意外返回新实体信息。为深入研究此现象,我们构建了EC-Bench诊断基准,直接探测编辑前后图像-实体绑定的变化。分析表明,现有方法未能区分图像-实体(I-E)绑定与实体-实体(E-E)关系知识,导致模型将E-E关联作为捷径过度拟合:图像仍被视为原实体,新实体名仅作为虚假标识。我们进一步探索缓解策略,发现限制编辑仅作用于I-E处理阶段,能促使编辑更忠实于实际绑定,显著降低EIC。基于这些发现,我们提出实现可信多模态知识编辑的原则性要求,并为未来研究提供方法指导。

原文摘要 · Abstract (English)

Multimodal knowledge editing (MKE) aims to correct the internal knowledge of large vision-language models after deployment, yet the behavioral patterns of post-edit models remain underexplored. In this paper, we identify a systemic failure mode in edited models, termed Entity Identity Confusion (EIC): edited models exhibit an absurd behavior where text-only queries about the original entity's identity unexpectedly return information about the new entity. To rigorously investigate EIC, we construct EC-Bench, a diagnostic benchmark that directly probes how image-entity bindings shift before and after editing. Our analysis reveals that EIC stems from existing methods failing to distinguish between Image-Entity (I-E) binding and Entity-Entity (E-E) relational knowledge in the model, causing models to overfit E-E associations as a shortcut: the image is still perceived as the original entity, with the new entity's name serving only as a spurious identity label. We further explore potential mitigation strategies, showing that constraining edits to the model's I-E processing stage encourages edits to act more faithfully on I-E binding, thereby substantially reducing EIC. Based on these findings, we discuss principled desiderata for faithful MKE and provide methodological guidance for future research.

多模态知识编辑模型幻觉视觉语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。