arXiv:2607.01191cs.CV2026-07被引 1

将视觉感知与推理分离,提升细粒度视觉理解能力。

Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning

论文配图:Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoning
图 1 · 摘自论文原文
  • 分两阶段:先定位关键视觉线索,再基于裁剪区域推理答案。
  • 在V-Star等数据集上,4B模型达93.2%准确率,显著优于基线。
  • 适用于高分辨率图像和多模态推理任务,适合视觉理解研究者。

细粒度视觉推理对视觉语言模型仍具挑战性,尤其当关键视觉线索隐藏在高分辨率图像中时。现有方法依赖反复裁剪或测试时视觉搜索引入局部证据,但未显式区分感知与推理。本文提出Perceive-to-Reason(P2R)框架,将细粒度视觉推理建模为两阶段过程:模型首先作为感知器定位与问题相关的证据,随后作为推理器基于标注图像和裁剪区域回答问题。为更好对齐训练与该解耦范式,我们进一步提出感知-推理交替GRPO(PRA-GRPO),一种角色感知的强化学习策略,仅使用最终答案监督,在感知与推理更新间交替进行。基于Qwen3-VL-Instruct-2B/4B/8B构建的P2R在不同模型规模下持续提升性能。其中,P2R-4B在V-Star上达93.2%,在HR-Bench-4K上为81.9%,在HR-Bench-8K上为80.5%,显著优于对应基线。实验还表明,P2R优势延伸至更广泛的多模态推理任务。结果表明,显式解耦感知与推理是细粒度视觉推理的有效框架。

原文摘要 · Abstract (English)

Fine-grained visual reasoning remains challenging for vision-language models, especially when small but critical visual cues are buried in high-resolution images. Existing approaches rely on repeated cropping or test-time visual search to introduce local evidence, but they typically do not explicitly distinguish perception from reasoning. In this paper, we propose Perceive-to-Reason (P2R), a unified framework that formulates fine-grained visual reasoning as a two-stage process: the model first localizes question-relevant evidence as a Perceiver, and then answers the question as a Reasoner based on the annotated image and cropped regions. To better align training with this decoupled formulation, we further introduce Perception-Reasoning Alternating GRPO (PRA-GRPO), a role-aware reinforcement learning strategy that alternates between perception-focused and reasoning-focused updates using only final-answer supervision. Built on top of Qwen3-VL-Instruct-2B/4B/8B, P2R consistently improves performance across model scales. In particular, P2R-4B achieves 93.2% on V-Star, 81.9% on HR-Bench-4K, and 80.5% on HR-Bench-8K, substantially outperforming its corresponding backbone. Further experiments show that the benefits of P2R extend beyond high-resolution benchmarks to broader multimodal reasoning tasks. These results suggest that explicitly decoupling perception from reasoning provides an effective framework for fine-grained visual reasoning.

视觉推理多模态解耦学习高分辨率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。