arXiv:2607.09438cs.CLcs.AI2026-07中稿 · ImageCLEF 2026被引 1

小模型也能靠测试时扩增提升多语言视觉问答能力

Test-Time Scaling for Small VLMs on Multilingual Visual MCQ

  • 用标准答案提示和修复步骤解决推理链未选答案的问题
  • 增加解码预算(从1k到2k token)提升3.7个百分点
  • 模型本身改进贡献最大,复杂方法性价比低

测试时扩增(TTS)能有效提升大模型推理能力,但对小型开源视觉语言模型是否适用尚不明确。我们在EXAMS-V多语言视觉多项选择基准上,对比了自一致性、描述后推理结合PRM引导束搜索及两种事后选择器,在Qwen2.5-VL-7B-Instruct和Qwen3.5-4B上进行评估。关键发现:运行条件比搜索或验证机制更重要。可解析性是首要因素:早期提示格式导致大量正确推理链未提交答案字母,标准答案提示与引导修复步骤可显著缓解此问题。更大的解码预算进一步提升性能:将每条推理链的令牌上限从1k增至2k,带来3.7个百分点提升;而增加推理链数量(8至16)仅提升0.15个百分点。一旦推理链有足够空间完成,复杂方法贡献有限:PRM引导束搜索在八倍成本下仍落后于简单自一致性0.39个百分点;无需训练的生成式批评者与训练好的多模态PRM均无法超越多数投票。最大的提升来自策略模型本身,提升11.4个百分点。最优配置在预留的ImageCLEF 2026测试集上达到84.1%准确率,位居视觉多项选择榜单第一。

原文摘要 · Abstract (English)

Test-time scaling (TTS) reliably improves reasoning in large language models, but whether it transfers to small open vision-language models remains unclear. We examine this on EXAMS-V, a multilingual visual multiple-choice benchmark, comparing self-consistency, describe-then-reason with PRM-guided beam search, and two post-hoc selectors across Qwen2.5-VL-7B-Instruct and Qwen3.5-4B. What matters is the conditions under which TTS runs, not the search or verification machinery. The largest factor is parseability: an early prompt format left many chains reasoning correctly yet never committing to an answer letter, which a standard answer cue and a guided repair step largely remove. A larger decoding budget removes the rest: raising the per-chain token limit from 1k to 2k recovers 3.7 pp, whereas sampling more chains (8 to 16) adds only 0.15 pp. Once chains have room to finish, elaborate methods contribute little: PRM-guided beam search trails plain self-consistency by 0.39 pp at over eight times the cost, and neither a training-free generative critic nor a trained multimodal PRM beats majority vote across both policies. The largest gain comes instead from the policy model itself (+11.4 pp). Our best configuration reaches 84.1% on the held-out ImageCLEF 2026 test split, ranking first on the Visual MCQ leaderboard.

视觉问答小模型测试时扩增

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。