arXiv:2511.12140cs.CLcs.CV2025-11

通过视觉回溯验证,精准检测多模态大模型的幻觉问题。

Seeing is Believing: Rich-Context Hallucination Detection for MLLMs via Backward Visual Grounding

  • 用像素级视觉定位模型反向检验回答与图像的一致性。
  • 在新基准上超越现有方法,接近GPT-4o检测能力。
  • 支持复杂场景且可解释,适合需要高可靠性的应用。

多模态大语言模型虽具备强大跨模态能力,但仍存在显著幻觉问题。为此,本文提出VBackChecker——一种基于“眼见为实”原则的无参考幻觉检测框架,利用具备推理与指代分割能力的像素级定位大模型,验证模型输出与视觉输入的一致性。该框架可有效处理丰富上下文场景,并提供可解释性。为此,设计了生成指令微调数据(R-Instruct)的新流水线,包含丰富上下文描述、定位掩码和难例负样本。进一步构建了新基准R^2-HalBench,涵盖18个MLLM的真实世界丰富描述,具有高质量标注,覆盖物体、属性和关系等多层次细节。VBackChecker在该基准上表现领先,性能媲美GPT-4o;在像素级定位任务中提升超10%。所有代码、数据与模型已开源。

原文摘要 · Abstract (English)

Multimodal Large Language Models (MLLMs) have unlocked powerful cross-modal capabilities, but still significantly suffer from hallucinations. As such, accurate detection of hallucinations in MLLMs is imperative for ensuring their reliability in practical applications. To this end, guided by the principle of "Seeing is Believing", we introduce VBackChecker, a novel reference-free hallucination detection framework that verifies the consistency of MLLMgenerated responses with visual inputs, by leveraging a pixellevel Grounding LLM equipped with reasoning and referring segmentation capabilities. This reference-free framework not only effectively handles rich-context scenarios, but also offers interpretability. To facilitate this, an innovative pipeline is accordingly designed for generating instruction-tuning data (R-Instruct), featuring rich-context descriptions, grounding masks, and hard negative samples. We further establish R^2 -HalBench, a new hallucination benchmark for MLLMs, which, unlike previous benchmarks, encompasses real-world, rich-context descriptions from 18 MLLMs with high-quality annotations, spanning diverse object-, attribute, and relationship-level details. VBackChecker outperforms prior complex frameworks and achieves state-of-the-art performance on R^2 -HalBench, even rivaling GPT-4o's capabilities in hallucination detection. It also surpasses prior methods in the pixel-level grounding task, achieving over a 10% improvement. All codes, data, and models are available at https://github.com/PinxueGuo/VBackChecker.

幻觉检测多模态视觉定位可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。