arXiv:2601.04442cs.CVcs.CL2026-01ACL被引 13

让视觉语言模型避免过度思考,提升推理速度和准确率。

Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization

  • 设计动态路由机制,按需选择快速、重看图像或深度反思路径。
  • 在5个基准上实现更高准确率,响应长度减少30%以上。
  • 适合追求高效精准推理的视觉理解应用开发者。

大型视觉语言模型(LVLM)通过链式思维机制生成逐步推理,但此类慢思考方法常导致过度思考,对简单问题也产生冗长回答,造成推理效率下降甚至准确率降低。现有方法虽尝试自适应推理策略,却忽视了根本瓶颈:视觉感知失败。本文认为稳定推理依赖底层视觉锚定,多数错误源于感知不准确而非思虑不足。为此提出门控感知-推理优化(GPRO),一种元推理控制器,在每一步动态分配计算至三个路径:轻量快速路径、重新审视图像的慢感知路径、内部自我反思的慢推理路径。通过约79万样本的教师模型标注,区分感知幻觉与推理错误,以多目标强化学习训练控制器,在任务准确率与计算成本间权衡。实验在五个基准上表明,GPRO显著提升准确率与效率,优于近期慢思考方法,且生成文本明显更短。

原文摘要 · Abstract (English)

Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models produce excessively verbose responses even for simple queries, resulting in test-time inefficiency and even degraded accuracy. Prior work has attempted to mitigate this issue via adaptive reasoning strategies, but these methods largely overlook a fundamental bottleneck: visual perception failures. We argue that stable reasoning critically depends on low-level visual grounding, and that reasoning errors often originate from imperfect perception rather than insufficient deliberation. To address this limitation, we propose Gated Perception-Reasoning Optimization (GPRO), a meta-reasoning controller that dynamically routes computation among three decision paths at each generation step: a lightweight fast path, a slow perception path for re-examining visual inputs, and a slow reasoning path for internal self-reflection. To learn this distinction, we derive large-scale failure attribution supervision from approximately 790k samples, using teacher models to distinguish perceptual hallucinations from reasoning errors. We then train the controller with multi-objective reinforcement learning to optimize the trade-off between task accuracy and computational cost under uncertainty. Experiments on five benchmarks demonstrate that GPRO substantially improves both accuracy and efficiency, outperforming recent slow-thinking methods while generating significantly shorter responses.

视觉语言模型链式思维推理优化效率提升

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。