arXiv:2511.10037cs.AI2025-11AAAI被引 20

用全局规划取代逐步决策,提升复杂工具调用的智能水平

Beyond ReAct: A Planner-Centric Framework for Complex Tool-Augmented LLM Reasoning

  • 设计全局图规划器,用有向无环图统筹多工具任务流程
  • 在StableToolBench上达到新最佳性能,复杂任务执行成功率显著提升
  • 适合需要多步、跨工具协作的智能系统研发者参考

现有工具增强型大模型在处理复杂查询时面临严重挑战。当前框架如ReAct因依赖增量式决策,易陷入局部优化陷阱。为此,我们提出一种新型规划中心范式——规划-执行(Plan-Execute),通过架构创新从根本上解决局部优化瓶颈。核心是引入一个新型规划器模型,对复杂查询进行全局有向无环图(DAG)规划,实现超越传统工具协调的优化执行。我们还构建了ComplexTool-Plan大规模基准数据集,包含需复杂多工具组合与协调的查询。同时,提出两阶段训练方法,融合监督微调(SFT)与组相对策略优化(GRPO),通过结构化DAG规划系统性提升规划器的工具选择准确率与全局规划意识。当与强执行器结合时,该框架在StableToolBench复杂用户查询基准上达到最先进性能,展现出卓越的端到端执行能力与对复杂多工具工作流的鲁棒处理能力。

原文摘要 · Abstract (English)

Existing tool-augmented large language models (LLMs) encounter significant challenges when processing complex queries. Current frameworks such as ReAct are prone to local optimization traps due to their reliance on incremental decision-making processes. To address these limitations, we propose a novel Planner-centric Plan-Execute paradigm that fundamentally resolves local optimization bottlenecks through architectural innovation. Central to our approach is a novel Planner model that performs global Directed Acyclic Graph (DAG) planning for complex queries, enabling optimized execution beyond conventional tool coordination. We also introduce ComplexTool-Plan, a large-scale benchmark dataset featuring complex queries that demand sophisticated multi-tool composition and coordination capabilities. Additionally, we develop a two-stage training methodology that integrates Supervised Fine-Tuning (SFT) with Group Relative Policy Optimization (GRPO), systematically enhancing the Planner's tool selection accuracy and global planning awareness through structured DAG-based planning. When integrated with a capable executor, our framework achieves state-of-the-art performance on the StableToolBench benchmark for complex user queries, demonstrating superior end-to-end execution capabilities and robust handling of intricate multi-tool workflows.

大模型推理规划生成工具调用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。