让视觉语言模型学会区分看错还是想错,精准改进感知能力。
Bad Seeing or Bad Thinking? Rewarding Perception for Multimodal Reasoning

- 将推理过程拆解为感知与思考交替步骤,实现对感知的单独监督。
- 引入盲眼推理代理验证感知质量,不依赖最终答案奖励。
- 用结构化语义验证替代大模型打分,提升训练可扩展性。
实现鲁棒的视觉-语言协同是先进视觉语言模型的核心目标。现有方法通过架构设计或代理工作流推进,但常受限于静态文本推理,且受外部代理复杂性带来的高昂计算与工程成本影响。更糟的是,这种投入并未带来相应性能提升,反而出现感知与推理的“跷跷板效应”。本文提出根本性反思:问题根源在于模态责任分配模糊——当模型出错时,是感知失误(看错)还是逻辑错误(想错)?为此,我们提出一种强化学习框架,通过可靠奖励感知保真度来改善感知-推理协同。显式分解生成过程为交错的感知与推理步骤,实现对感知的精准监督。关键创新是引入感知验证(PV),利用“盲眼推理”代理独立奖励感知准确性,不依赖推理结果。此外,为实现跨自由形式视觉语言任务的规模化训练,提出结构化语义验证,以结构化算法执行替代高方差的大模型评判。这些技术集成到模态感知归因(MoCA)机制中,能将奖励精准路由至错误源头——是看错还是想错——使单一模型在广泛任务上同步提升性能。
原文摘要 · Abstract (English)
Achieving robust perception-reasoning synergy is a central goal for advanced Vision-Language Models (VLMs). Recent advancements have pursued this goal via architectural designs or agentic workflows. However, these approaches are often limited by static textual reasoning or complicated by the significant compute and engineering burden of external agentic complexity. Worse, this heavy investment does not yield proportional gains, often witnessing a "seesaw effect" on perception and reasoning. This motivates a fundamental rethinking of the true bottleneck. In this paper, we argue that the root cause of this trade-off is an ambiguity in modality credit assignment: when a VLM fails, is it due to flawed perception ("bad seeing") or flawed logic ("bad thinking")? To resolve this, we introduce a reinforcement learning framework that improves perception-reasoning synergy by reliably rewarding the perception fidelity. We explicitly decompose the generation process into interleaved perception and reasoning steps. This decoupling enables targeted supervision on perception. Crucially, we introduce Perception Verification (PV), leveraging a "blindfolded reasoning" proxy to reward perceptual fidelity independently of reasoning outcomes. Furthermore, to scale training across free-form VL tasks, we propose Structured Verbal Verification, which replaces high-variance LLM judging with structured algorithmic execution. These techniques are integrated into a Modality-Aware Credit Assignment (MoCA) mechanism, which routes rewards to the specific source of error -- either bad seeing or bad thinking -- enabling a single VLM to achieve simultaneous performance gains across a wide task spectrum.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。