arXiv:2604.03307cs.CVcs.AI2026-04被引 2

让多模态大模型主动看图推理,减少细粒度视觉幻觉。

V-Reflection: Transforming MLLMs from Passive Observers to Active Interrogators

论文配图:V-Reflection: Transforming MLLMs from Passive Observers to Active Interrogators
图 1 · 摘自论文原文
  • 通过‘思考-再看’机制,让模型用隐状态主动检索视觉特征。
  • 在6个感知密集型任务中显著缩小细粒度感知差距。
  • 适合需要精准视觉理解的复杂推理场景。

多模态大语言模型虽取得显著进展,但在细粒度任务中仍易产生与感知相关的幻觉。其根本原因在于:推理主要局限于语言领域,将视觉输入视为静态、无关推理的前奏,而非动态参与的主体。因此现有模型仅作被动观察者,无法回溯视觉细节以支撑动态推理。为此,我们提出V-Reflection框架,通过“思考-再看”视觉反思机制,将多模态大模型转变为积极的提问者。在推理过程中,隐状态作为动态探针,主动探测视觉特征空间,为每一步推理锚定关键证据。方法采用两阶段蒸馏:首先,框引导压缩模块(BCM)通过显式空间定位建立稳定的像素到隐状态目标;其次,动态自回归压缩(DAC)模块将模型隐藏状态映射为动态探针,对全局视觉特征图进行检索。通过将BCM教师的空间专长蒸馏至DAC学生,V-Reflection内化了定位关键证据的能力。推理时,两个模块均不激活,保持纯端到端自回归解码于隐空间,实现最优效率。大量实验表明,该方法在六个感知密集型基准上均有效,显著缩小细粒度感知差距。可视化证实,隐层推理可自主定位任务关键视觉证据。

原文摘要 · Abstract (English)

Multimodal Large Language Models (MLLMs) have achieved remarkable success, yet they remain prone to perception-related hallucinations in fine-grained tasks. This vulnerability arises from a fundamental limitation: their reasoning is largely restricted to the language domain, treating visual input as a static, reasoning-agnostic preamble rather than a dynamic participant. Consequently, current models act as passive observers, unable to re-examine visual details to ground their evolving reasoning states. To overcome this, we propose V-Reflection, a framework that transforms the MLLM into an active interrogator through a "think-then-look" visual reflection mechanism. During reasoning, latent states function as dynamic probes that actively interrogate the visual feature space, grounding each reasoning step for task-critical evidence. Our approach employs a two-stage distillation strategy. First, the Box-Guided Compression Module (BCM) establishes stable pixel-to-latent targets through explicit spatial grounding. Next, a Dynamic Autoregressive Compression (DAC) module maps the model's hidden states into dynamic probes that interrogate the global visual feature map. By distilling the spatial expertise of the BCM teacher into the DAC student, V-Reflection internalizes the ability to localize task-critical evidence. During inference, both modules remain entirely inactive, maintaining a purely end-to-end autoregressive decoding in the latent space with optimal efficiency. Extensive experiments demonstrate the effectiveness of our V-Reflection across six perception-intensive benchmarks, significantly narrowing the fine-grained perception gap. Visualizations confirm that latent reasoning autonomously localizes task-critical visual evidence.

多模态视觉推理幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。