arXiv:2606.29812cs.CV2026-06

让多模态模型在不同视角下保持答案一致,提升推理鲁棒性。

Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning

论文配图:Consistency as Inductive Bias: Learning Cross-View Invariance for Robust Multimodal Reasoning
图 1 · 摘自论文原文
  • 通过联合奖励一致且正确的跨视角生成结果,引入一致性归纳偏置。
  • 在数学、通用任务和幻觉检测上,平均提升6.2%以上准确率。
  • 无需额外生成或标注,适用于现有强化学习训练框架。

归纳偏置通过编码任务结构引导学习向可泛化解收敛。本文指出当前多模态大模型(MLLMs)缺少关键偏置:跨视角一致性,即同一实例的不同语义等价视图应产生相同答案。标准基于可验证奖励的强化学习(RLVR)不强制此约束,仅对每个视觉输入独立赋分。即使使用数据增强(DA),变换后的视图也通常独立奖励,当视图内奖励饱和后难以提供有效信号。为此,本文提出ConsistRoll——一种利用GRPO的分组采样机制,将原始视图与语义不变的变换视图置于同一批次生成中,仅当配对输出均正确且一致时才给予联合奖励。该方法将一致性转化为在线信用分配信号,无需额外生成开销或人工标注。理论证明跨视角一致性是有效的归纳偏置,ConsistRoll引入了数据增强所缺失的跨视角修正项,惩罚视图依赖性并缓解优势崩溃。在数学、通用任务及幻觉检测等多个基准测试中,ConsistRoll均实现显著且稳健的性能提升。

原文摘要 · Abstract (English)

Inductive biases steer learning toward generalizable solutions by encoding task structure. In this work, we identify a crucial missing bias in MLLMs: cross-view consistency, \textit{i.e.}, semantically invariant views of the same instance should lead to the same answer. Standard reinforcement learning with verifiable rewards (RLVR) objectives do not impose this constraint, but instead assign pointwise rewards to each visual input. Even with data augmentation (DA), transformed views are typically rewarded independently, providing little signal once within-view rewards saturate. We propose \textbf{ConsistRoll}, a simple but effective method that injects cross-view consistency into RLVR training by reusing the group-sampling mechanism of GRPO. Specifically, ConsistRoll places original and semantically invariant transformed views in the same generation group, and assigns a joint reward only when paired completions are both correct and consistent. In this way, ConsistRoll turns consistency into an online credit-assignment signal, \textbf{without extra generation overhead and annotations}. Theoretically, we show that cross-view consistency is a valid inductive bias, and ConsistRoll introduces a cross-view correction term absent from DA, penalizing view dependence and alleviating advantage collapse. Comprehensive benchmarks across math, general-purpose, hallucination domains confirm that ConsistRoll achieves robust improvements in multimodal reasoning.

多模态推理强化学习一致性正则

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。