arXiv:2506.08927cs.CVcs.AI2025-06EMNLP被引 5

让非推理模型通过提问生成长链思维,无需额外训练。

Socratic-MCTS: Test-Time Visual Reasoning by Asking the Right Questions

  • 用蒙特卡洛树搜索思想设计子问题提问机制
  • 在MMMU-PRO上整体提升2%,人文学科达9%增幅
  • 适合部署中但缺乏推理能力的现有视觉语言模型

近期视觉语言模型研究聚焦于通过蒸馏和强化学习赋予其隐式长链思维能力,类似语言模型的成功。但对已训练并广泛部署的非推理型模型,我们是否只能放弃?本文提出一种受蒙特卡洛树搜索启发的算法,将子问题-子答案对注入模型输出流,将推理视为搜索过程,使子问题成为推理轨迹中的潜在决策节点。该方法帮助模型连接碎片化知识,生成更长的推理链。在三个基准测试中均取得一致提升,尤其在MMMU-PRO上实现2%的整体增益,人文学科领域提升达9%。

原文摘要 · Abstract (English)

Recent research in vision-language models (VLMs) has centered around the possibility of equipping them with implicit long-form chain-of-thought reasoning -- akin to the success observed in language models -- via distillation and reinforcement learning. But what about the non-reasoning models already trained and deployed across the internet? Should we simply abandon them, or is there hope for a search mechanism that can elicit hidden knowledge and induce long reasoning traces -- without any additional training or supervision? In this paper, we explore this possibility using a Monte Carlo Tree Search (MCTS)-inspired algorithm, which injects subquestion-subanswer pairs into the model's output stream. We show that framing reasoning as a search process -- where subquestions act as latent decisions within a broader inference trajectory -- helps the model "connect the dots" between fragmented knowledge and produce extended reasoning traces in non-reasoning models. We evaluate our method across three benchmarks and observe consistent improvements. Notably, our approach yields a 2% overall improvement on MMMU-PRO, including a significant 9% gain in Liberal Arts.

视觉推理思维链MCTS无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。