arXiv:2505.21547cs.CVcs.AI2025-05被引 4

通过修改隐空间嵌入,减少离散图像编码器的幻觉问题。

Image Tokens Matter: Mitigating Hallucination in Discrete Tokenizer-based Large Vision-Language Models via Latent Editing

  • 基于共现图与图神经网络识别高频共现图像片段。
  • 发现幻觉多来自占主导地位且关联性高的图像簇。
  • 生成时抑制缺失图像令牌影响,保持表达能力。

基于离散图像标记器的大规模视觉语言模型(LVLM)通过将视觉输入编码为有限的标记集来统一多模态表示。尽管有效,这些模型仍会虚构不存在的物体。我们假设这源于训练期间形成的视觉先验:当某些图像标记在相同空间区域频繁共现并代表共同物体时,它们会与这些物体的语义描述强烈关联。因此,模型可能通过唤起与现有标记共现但视觉上缺失的标记而产生幻觉。为验证此假设,我们使用分割数据集构建图像标记共现图,并采用带有对比学习的图神经网络结合聚类方法,对在相似视觉上下文中频繁共现的标记进行分组。实验发现,幻觉主要对应于占据输入主导地位的标记簇,且这些簇中视觉缺失标记与幻觉对象的相关性远高于图像中实际存在的标记。基于此观察,我们提出一种通过生成过程中修改隐空间图像嵌入来抑制视觉缺失标记影响的方法。实验表明,该方法可有效降低幻觉,同时保持模型表达力。代码已开源。

原文摘要 · Abstract (English)

Large Vision-Language Models (LVLMs) with discrete image tokenizers unify multimodal representations by encoding visual inputs into a finite set of tokens. Despite their effectiveness, we find that these models still hallucinate non-existent objects. We hypothesize that this may be due to visual priors induced during training: When certain image tokens frequently co-occur in the same spatial regions and represent shared objects, they become strongly associated with the verbalizations of those objects. As a result, the model may hallucinate by evoking visually absent tokens that often co-occur with present ones. To test this assumption, we construct a co-occurrence graph of image tokens using a segmentation dataset and employ a Graph Neural Network (GNN) with contrastive learning followed by a clustering method to group tokens that frequently co-occur in similar visual contexts. We find that hallucinations predominantly correspond to clusters whose tokens dominate the input, and more specifically, that the visually absent tokens in those clusters show much higher correlation with hallucinated objects compared to tokens present in the image. Based on this observation, we propose a hallucination mitigation method that suppresses the influence of visually absent tokens by modifying latent image embeddings during generation. Experiments show our method reduces hallucinations while preserving expressivity. Code is available at https://github.com/weixingW/CGC-VTD/tree/main

幻觉抑制视觉语言模型图像标记隐空间编辑

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。