arXiv:2511.21689cs.CLcs.AI2025-11被引 35

用小模型高效调度工具,让智能系统更聪明又省成本。

ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration

  • 用强化学习训练小模型协调多种工具与大模型
  • 在人类终极考试中得分37.1%,比GPT-5高但效率高2.5倍
  • 适合需要低成本高智能的复杂任务系统开发者

大语言模型虽强大,但在解决如‘人类终极考试’(HLE)这类深层复杂问题时仍面临概念挑战与计算开销。我们发现,由小型调度器管理其他模型和多种工具,不仅能提升智能上限,还能提高效率。为此提出ToolOrchestra方法,通过结合结果、效率和用户偏好感知的强化学习训练小型调度器。基于此,我们构建了80亿参数的Orchestrator模型,在HLE上取得37.1%的分数,优于GPT-5的35.1%,且效率高出2.5倍;在tau2-Bench和FRAMES上超越GPT-5,成本仅为其约30%。分析显示,Orchestrator在性能与成本间达到最佳平衡,并能泛化至未见工具。结果表明,以轻量级调度模型组合多样化工具,比现有方法更高效、更有效,为可扩展的工具增强推理系统铺平道路。

原文摘要 · Abstract (English)

Large language models are powerful generalists, yet solving deep and complex problems such as those of the Humanity's Last Exam (HLE) remains both conceptually challenging and computationally expensive. We show that small orchestrators managing other models and a variety of tools can both push the upper bound of intelligence and improve efficiency in solving difficult agentic tasks. We introduce ToolOrchestra, a method for training small orchestrators that coordinate intelligent tools. ToolOrchestra explicitly uses reinforcement learning with outcome-, efficiency-, and user-preference-aware rewards. Using ToolOrchestra, we produce Orchestrator, an 8B model that achieves higher accuracy at lower cost than previous tool-use agents while aligning with user preferences on which tools are to be used for a given query. On HLE, Orchestrator achieves a score of 37.1%, outperforming GPT-5 (35.1%) while being 2.5x more efficient. On tau2-Bench and FRAMES, Orchestrator surpasses GPT-5 by a wide margin while using only about 30% of the cost. Extensive analysis shows that Orchestrator achieves the best trade-off between performance and cost under multiple metrics, and generalizes robustly to unseen tools. These results demonstrate that composing diverse tools with a lightweight orchestration model is both more efficient and more effective than existing methods, paving the way for practical and scalable tool-augmented reasoning systems.

智能调度工具使用效率优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。