arXiv:2604.11025cs.CV2026-04被引 1

解决图像推理中因定位错误导致的循环困境,提升多模态模型准确性。

Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Images

  • 通过感知级闭环框架,动态探索图像区域并控制证据提交
  • 在多个高分辨率基准上超越现有方法,且更高效地利用计算资源
  • 适合需要精准视觉推理的应用,如医疗影像分析或复杂场景理解

近期多模态大模型支持'图像思维',在推理中调用缩放、裁剪等视觉工具以检查图像区域。然而这些系统在细粒度推理中仍脆弱:要获取关键细节,模型必须准确定位到正确区域,但知道哪区域正确又依赖已观察到该细节。我们识别出这种循环依赖为'定位悖论',发现定位错误极少在单次推理轨迹中自我修正——一旦误检错误区域,后续推理均基于此错误信息,误差持续传递至最终答案;且由于每条轨迹独立构建证据,答案级聚合会丢弃区分轨迹的关键信息。我们提出测试时感知扩展(TTSP),一个将感知作为可扩展推理单元的闭环框架,沿两个维度分配计算:熵门控感知探索通过关键词熵控制是否提交证据,避免不确定信息干扰;证据引导迭代精炼将验证过的观察提炼为可修正的证据清单,引导后续轮次重新检查未解决区域。在高分辨率与通用多模态基准上,TTSP始终优于强基线,并在提升定位质量的同时保持良好的令牌效率。

原文摘要 · Abstract (English)

Recent multimodal large language models (MLLMs) support Thinking with Images, invoking visual tools such as zooming and cropping to inspect image regions during inference. Yet these systems remain brittle in fine-grained reasoning: to acquire a decisive detail, a model must ground its attention on the correct region, but knowing which region is correct presupposes having already observed that detail. We identify this circular dependency as the grounding paradox, show that grounding errors are rarely self-corrected within a single trajectory---once a misleading region is inspected, all subsequent reasoning conditions on that observation and the error propagates to the final answer---and observe that because each trajectory constructs its own evidence, answer-level aggregation discards the very information that distinguishes trajectories. We propose Test-Time Scaling over Perception (TTSP), a closed-loop framework that treats perception as the unit of scalable inference and allocates compute along two axes: Entropy-Gated Perceptual Exploration samples diverse trajectories and uses critical-token entropy to withhold evidence the model cannot commit to, while Evidence-Guided Iterative Refinement distills validated observations into a correctable Evidence Ledger that steers later rounds to re-inspect unresolved regions. Across high-resolution and general multimodal benchmarks, TTSP consistently outperforms strong test-time scaling baselines, while improving grounding quality with favorable token efficiency.

多模态推理图像理解测试时扩展认知纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。