arXiv:2608.08907cs.CVcs.AI2026-08被引 1

让AI学会何时何地用视觉工具,避免盲目模仿或无效调用。

ToolVision: Learning When and How to Use Visual Tools with Capability-Aligned Supervision

论文配图:ToolVision: Learning When and How to Use Visual Tools with Capability-Aligned Supervision
图 1 · 摘自论文原文
  • 用多智能体搜索+学生模型评分,筛选真正有效的工具使用路径。
  • 仅在工具明显有用时才奖励使用,避免无效调用被鼓励。
  • 无需人工标注,自动构建训练信号,适合多模态推理任务研究者。

利用图像思考使多模态模型可通过代码调用视觉工具弥补感知不足。然而,当前的SFT-then-RL范式在各阶段存在监督错位:SFT期望教会如何使用工具,但强教师轨迹的成功依赖于小模型无法复现的感知能力,导致学生仅模仿工具调用模式而未掌握其用途;RL期望教会何时使用工具,但仅基于结果的奖励使易出错的工具执行成为负担,抑制工具使用,而对所有正确工具调用路径的统一奖励则鼓励了有效但低效的操作。为解决这两个错位问题,我们提出ToolVision。在SFT阶段,通过多智能体流水线探索候选轨迹,并由包含学生规模模型的委员会逐步评估证据增益,筛选并修剪分支,仅保留成功执行且答案正确的轨迹用于训练。在RL前,ToolVision比较学习者有无工具的表现,仅在工具带来明显优势的问题上奖励成功使用。两种信号均从公开任务数据自动构建,无需额外人工标注工具使用或必要性。ToolVision-8B在全部七个主基准上优于基线模型,在三个高分辨率基准上超越Thyme-7B、CodeVision-8B和CodeDance-7B,且在V*和HRBench 8K上表现超过Qwen3-VL-32B-Thinking。我们将公开数据集与源代码。

原文摘要 · Abstract (English)

Thinking with images allows a multimodal model to compensate for limited perception by invoking visual tools through code. Yet the prevailing SFT-then-RL recipe creates a different supervision misalignment at each stage. SFT is expected to teach how to use tools, but trajectories from stronger teachers may succeed through perceptual capabilities that a smaller student cannot reliably reproduce or exploit, causing the student to imitate tool-call patterns without learning how to make them useful. RL is expected to teach when to use tools, but outcome-only rewards make fallible tool execution a liability and suppress tool use, whereas a blanket bonus for every correct tool-using trajectory encourages valid but ineffective operations. To address these two misalignments, we introduce ToolVision. During SFT, a multi-agent pipeline explores candidate trajectories, and a committee including student-scale models scores stepwise evidence gain to rank and prune the search branches. Only successfully executed trajectories with correct final answers are retained for SFT. Before RL, ToolVision compares the learner's performance with and without tools, then rewards successful tool use only on questions where tools provide a clear benefit. Both signals are constructed automatically from public task data without additional human annotations of tool use or necessity. ToolVision-8B improves over its base on all seven main benchmarks, surpasses Thyme-7B, CodeVision-8B, and CodeDance-7B on all three high-resolution benchmarks, and outperforms Qwen3-VL-32B-Thinking on V* and HRBench 8K. We will publicly release the datasets and source code.

多模态工具使用强化学习视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。