arXiv:2506.19500cs.AIcs.CL2025-06中稿 · ICML被引 1

让大模型像导航一样规划工具调用顺序,避免出错累积。

NaviAgent: Graph-Driven Bilevel Planning for Scalable Tool Orchestration

  • 用图结构建模工具间依赖关系,分两层规划与执行。
  • 复杂任务成功率提升13.1点,真实场景下平均增4.3~12.0点。
  • 适合需要调用多个外部工具的智能助手研发者。

大型语言模型(LLMs)越来越多地作为函数调用代理,通过调用外部工具来处理超出其静态知识范围的任务。然而,它们通常逐个调用工具而缺乏对任务结构的全局视角。由于工具之间常存在依赖关系,这导致错误积累且难以扩展,尤其在面对数百甚至上千个工具时更为明显。为此,我们提出 NaviAgent,一种基于图结构建模工具关系的显式双层架构,将任务规划与工具执行解耦。在规划层,基于 LLM 的代理决定是否直接响应、澄清意图,或检索并执行独立于工具间复杂性的工具链。在执行层,工具世界导航模型(TWNM)编码工具间的结构与行为关系,引导代理生成可扩展且鲁棒的调用序列。结合真实工具交互反馈,NaviAgent 实现了规划与执行之间的闭环对齐,支持在大规模工具生态中自适应导航。在 API-Bank 与 ToolBench 上的评估显示任务成功率(TSR)持续提升,其中 TWNM 在复杂任务上平均提升 13.1 点。进一步在 7 个领域共 50 个真实 API 上测试,成功率提升 4.3–12.0 点,步骤更少、延迟更低,展现出对真实动态环境的良好泛化能力。

原文摘要 · Abstract (English)

Large Language Models (LLMs) increasingly act as function-call agents that invoke external tools to tackle tasks beyond their static knowledge. However, they typically invoke tools one at a time without a global view of task structure. As tools often depend on one another, this leads to error accumulation and poor scalability, particularly when scaling to hundreds or thousands of tools. To address these limitations, we propose NaviAgent, an explicit bilevel architecture that decouples task planning from tool execution through graph-based modeling of tool relations. At the planning level, the LLM-based agent decides whether to respond directly, clarify intent, or retrieve and execute a toolchain independent of inter-tool complexity. At the execution level, a Tool World Navigation Model (TWNM) encodes structural and behavioral relations among tools, steering the agent to compose scalable and robust invocation sequences. Incorporating feedback from real tool interactions, NaviAgent achieves closed-loop alignment between planning and execution, enabling adaptive navigation in large-scale tool ecosystems. Evaluations on API-Bank and ToolBench show consistent improvements in task success rate (TSR), with TWNM yielding an average gain of 13.1 points on complex tasks. Further tests on 50 real APIs across 7 domains show consistent gains of 4.3--12.0 points, with fewer steps and latency, demonstrating robust generalization under real-world dynamics.

工具编排大模型导航模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。