让视觉语言模型像人一样快慢思考,既省 token 又更准。
Learning to Think Fast and Slow for Visual Language Models
- 根据问题难易自动切换快慢思考模式,模仿人类认知策略。
- 在多个视觉推理任务上超越基线模型,准确率提升显著且更省计算资源。
- 适合需要高效推理的场景,如实时问答、移动端部署等。
面对复杂问题时,人类倾向于进行缓慢而深思熟虑的思考;而对于简单问题,则给出快速直觉回答。这种双系统思维能高效分配认知资源,仅在必要时投入深度分析。然而,现有面向推理的视觉语言模型(VLMs)大多被训练为统一生成长篇推理,导致在只需简洁回答时产生大量令牌浪费。本文观察到预训练通用型VLMs对不同问题类型自然表现出响应长度差异:数学题响应较长,感知类问题则较短。与现有工作强制生成长推理的做法不同,我们提出利用这一先验,构建显式的双模式思考机制。具体而言,每个训练样本被锚定于与模型自然响应倾向一致的‘快速’或‘慢速’思维前缀。随后,通过改进的GRPO算法学习双系统思维,实现自主或手动的思考模式选择。在多种视觉推理基准上的广泛实验表明,所提出的DualMindVLM模型显著优于基线模型,并在保持高令牌效率的同时达到顶尖推理性能。
原文摘要 · Abstract (English)
When faced with complex problems, we tend to engage in slower, more deliberate thinking. In contrast, for simple questions we give quick, intuitive responses. This dual-system thinking approach allows us to allocate cognitive resources efficiently, reserving deeper analytical effort for tasks that truly require it. However, existing reasoning-oriented visual language models (VLMs) are mostly trained to generate uniformly long reasoning, leading to substantial token waste when concise answers would suffice. In this paper, we observe that pre-trained, general-purpose VLMs manifest variations in response length for different question types, e.g., longer reasoning for math questions while shorter on perception problems. Different from existing work that overrides this prior by stimulating long reasoning without considering the problem complexity, we propose to leverage this prior to develop an explicit dual-mode thinking mechanism. Specifically, we anchor each training instance to either a fast or slow thinking prefix consistent with the model's natural response length tendency. Then, GRPO is adapted to learning dual-system thinking, enabling both autonomous and manual thinking mode selection. Extensive experiments across a wide variety of visual reasoning benchmarks demonstrate that our model, named DualMindVLM, significantly outperforms the base model and achieves state-of-the-art reasoning performance while maintaining high token efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。