arXiv:2605.08802cs.CV2026-05被引 1

通过对比优化提升视觉推理的探索性,让模型更自由地思考。

CoLVR: Enhancing Exploratory Latent Visual Reasoning via Contrastive Optimization

论文配图:CoLVR: Enhancing Exploratory Latent Visual Reasoning via Contrastive Optimization
图 1 · 摘自论文原文
  • 用角度扰动引导的对比学习扩展语义空间,避免嵌入受限。
  • 在视觉推理轨迹上引入强化学习奖励,提升多样性与精细度。
  • 在多个基准上显著优于现有方法,适合需要创造性推理的任务。

由于潜在视觉推理具备探索性推理的潜力,近期工作倾向于通过传播连续隐藏状态而非解码中间步骤为离散标记,使多模态大语言模型(MLLMs)实现视觉推理。然而,现有方法通常依赖硬对齐目标强制潜在表示匹配预定义视觉特征,严重限制了潜在推理过程的探索性。为此,我们提出CoLVR(潜在视觉推理的对比优化)。CoLVR引入潜在对比训练框架:首先,基于角度扰动的潜在对比目标学习多样且探索性的表示,扩展语义潜在空间并避免过度约束嵌入;其次,采用潜在轨迹对比奖励进行强化学习后训练,实现对潜在视觉推理过程的细粒度优化,从而促进多样化的推理行为。实验表明,CoLVR显著增强了潜在表示的探索能力,在VSP和Jigsaw上分别取得5.83%和8.00%的平均提升,同时在跨域基准MMStar上获得3.40%的性能增益。数据、代码与模型已公开于https://github.com/Oscar-dzy/CoLVR。

原文摘要 · Abstract (English)

Due to the potential for exploratory reasoning of Latent Visual Reasoning, recent works tend to enable MLLMs (Multimodal Large Language Models) to perform visual reasoning by propagating continuous hidden states instead of decoding intermediate steps into discrete tokens. However, existing works typically rely on hard alignment objectives to force latent representations to match predefined visual features, thereby severely limiting the exploratory of latent reasoning process. To address this problem, we propose CoLVR (Contrastive Optimization for Latent Visual Reasoning). To obtain a more exploratory visual reasoning, CoLVR introduces a latent contrastive training framework. Firstly, CoLVR learns diverse and exploratory representations with a latent contrastive objective guided by angle-based perturbation, which expands the semantic latent space and avoids over-constrained embedding. Then, CoLVR employs a latent trajectory contrastive reward for RL (Reinforcement Learning) post-training to enable fine-grained optimization of latent visual reasoning process and thus fostering diverse reasoning behaviors. Experiments demonstrate that CoLVR significantly enhances the exploratory capability of latent representations, achieving average improvements of 5.83% on VSP and 8.00% on Jigsaw, while also outperforming existing latent models on out of domain benchmarks, with a 3.40% gain on MMStar. The data, codes, and models are released at https://github.com/Oscar-dzy/CoLVR.

视觉推理对比学习探索性推理多模态模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。