arXiv:2601.18631cs.AIcs.CL2026-01被引 6

让AI像人一样动态用工具解复杂视觉题,还能自学新工具。

AdaReasoner: Dynamic Tool Orchestration for Iterative Visual Reasoning

  • 通过强化学习自动学会选工具、排顺序,不依赖人工标注。
  • 在多个任务上比7B模型平均提升24.9%,超越GPT-5表现。
  • 适合需要多步推理与工具协同的开放场景,如VSP、Jigsaw任务。

当人类面对超出自身能力的问题时,会借助工具,这为提升多模态大语言模型(MLLMs)的视觉推理能力提供了可行范式。有效推理取决于知道何时使用哪些工具,如何在多步中组合它们,即使面对新工具或新任务也需适应。我们提出 extbf{AdaReasoner},一种将工具使用作为通用推理技能而非特定工具或显式监督行为的多模态模型家族。其核心包括:(i) 可扩展的数据构建管道,使模型接触长程、多步工具交互;(ii) Tool-GRPO强化学习算法,基于最终任务成功优化工具选择与序列;(iii) 自适应学习机制,动态调节工具使用。这些组件使模型能从任务上下文和中间结果推断工具效用,实现多工具协调并泛化至未见工具。实验证明,AdaReasoner展现出强大的自适应与泛化能力:能自主启用有益工具、抑制无关工具,并根据任务需求调整使用频率,即便从未显式训练过此行为。这些能力带来跨挑战性基准的顶尖性能,平均使7B基线模型提升24.9%,并在VSP、Jigsaw等任务上超越强大多模态闭源系统如GPT-5。

原文摘要 · Abstract (English)

When humans face problems beyond their immediate capabilities, they rely on tools, providing a promising paradigm for improving visual reasoning in multimodal large language models (MLLMs). Effective reasoning, therefore, hinges on knowing which tools to use, when to invoke them, and how to compose them over multiple steps, even when faced with new tools or new tasks. We introduce \textbf{AdaReasoner}, a family of multimodal models that learn tool use as a general reasoning skill rather than as tool-specific or explicitly supervised behavior. AdaReasoner is enabled by (i) a scalable data curation pipeline exposing models to long-horizon, multi-step tool interactions; (ii) Tool-GRPO, a reinforcement learning algorithm that optimizes tool selection and sequencing based on end-task success; and (iii) an adaptive learning mechanism that dynamically regulates tool usage. Together, these components allow models to infer tool utility from task context and intermediate outcomes, enabling coordination of multiple tools and generalization to unseen tools. Empirically, AdaReasoner exhibits strong tool-adaptive and generalization behaviors: it autonomously adopts beneficial tools, suppresses irrelevant ones, and adjusts tool usage frequency based on task demands, despite never being explicitly trained to do so. These capabilities translate into state-of-the-art performance across challenging benchmarks, improving the 7B base model by +24.9\% on average and surpassing strong proprietary systems such as GPT-5 on multiple tasks, including VSP and Jigsaw.

多模态推理工具调用强化学习自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。