arXiv:2605.11931cs.CV2026-05中稿 · ICML被引 1

让AI更会看:通过视觉感知提升多模态推理能力

Learn to Think: Improving Multimodal Reasoning through Vision-Aware Self-Improvement Training

论文配图:Learn to Think: Improving Multimodal Reasoning through Vision-Aware Self-Improvement Training
图 1 · 摘自论文原文
  • 用视觉注意力分数引导模型关注图像信息,避免语言偏见
  • 重采样部分正确推理路径,解决简单样本过训问题
  • 适用于多种训练场景,可显著提升多模态模型表现

后训练阶段引入显式推理路径是提升多模态大模型(MLLM)推理能力的常见方法。然而,获取高质量推理路径成本高昂。因此,自提升范式应运而生,使模型无需外部监督即可自动生成推理路径进行训练。尽管有效,现有方法存在两大缺陷:1)数据不平衡,简单样本被过度训练,而关键难样本训练不足;2)语言先验偏差,模型过度依赖语言线索,忽视视觉信息。为此,我们提出VISTA框架,一种面向多模态推理的视觉感知自提升训练方法。首先,引入前缀重采样策略,复用部分正确推理路径以高效收集数据;其次,设计视觉感知注意力分数,量化模型对视觉信息的关注程度。大量实验表明,VISTA可应用于监督微调与偏好学习等多种后训练场景,有效提升多种MLLM在多个任务上的多模态推理性能,例如在Qwen2.5-VL-3B-Instruct上实现最高+13.66%的平均性能提升。

原文摘要 · Abstract (English)

Post-training with explicit reasoning traces is common to improve the reasoning capabilities of Multimodal Large Language Models (MLLMs). However, acquiring high-quality reasoning traces is often costly and time-consuming. Hence, the self-improvement paradigm has emerged, enabling MLLMs to self-generate reasoning traces for training without external supervision. Despite its effectiveness, we reveal two shortcomings in the self-improvement training of MLLMs: 1) data imbalance, where simple samples are over-trained, but the challenging yet crucial samples are under-trained; 2) language prior bias, where MLLMs overly rely on linguistic priors while neglecting the visual cues. To this end, we propose VISTA, a vision-aware self-improvement training framework for enhancing the multimodal reasoning of MLLMs. Specifically, VISTA first introduces a prefix resampling strategy to reuse the partial correct reasoning traces for efficient data collection, and then designs a vision-aware attention score to quantify the model's focus on visual information. Extensive experiments show that VISTA can be applied to various post-training scenarios, i.e., supervised fine-tuning and preference learning, and effectively enhances the multimodal reasoning performance across various MLLMs and tasks, e.g., bringing up to +13.66% average performance gains for Qwen2.5-VL-3B-Instruct.

多模态推理自提升训练视觉感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。