arXiv:2510.21618cs.AIcs.CL2025-10中稿 · WWW 2026被引 75

DeepAgent让大模型自主用工具解复杂任务,还能自动记重要信息。

DeepAgent: A General Reasoning Agent with Scalable Toolsets

  • 统一思考、找工具、执行动作,全程自主决策
  • 在8个基准上表现优于现有方法,尤其在开放工具场景
  • 适合需要长期交互和灵活调用工具的复杂应用

大型推理模型虽具备强大问题解决能力,但现实任务常需外部工具与长时交互。现有代理框架多依赖预设流程,难以实现真正自主与全局完成。本文提出DeepAgent,一种端到端深度推理代理,可在单一连贯推理过程中实现自主思考、工具发现与动作执行。为应对长时交互挑战,引入自主记忆折叠机制,将过往交互压缩为结构化的情景、工作及工具记忆,减少误差累积同时保留关键信息。为高效稳定地学习通用工具使用,提出端到端强化学习策略ToolPO,利用大模型模拟API,并通过工具调用优势归因对工具调用标记进行细粒度奖励分配。在八个基准上的大量实验表明,DeepAgent在包括ToolBench、API-Bank、TMDB、Spotify、ToolHop等通用工具任务,以及ALFWorld、WebShop、GAIA、HLE等下游应用中,均持续优于基线模型,覆盖标注工具与开放集工具检索场景。代码与演示见https://github.com/RUC-NLPIR/DeepAgent。

原文摘要 · Abstract (English)

Large reasoning models have demonstrated strong problem-solving abilities, yet real-world tasks often require external tools and long-horizon interactions. Existing agent frameworks typically follow predefined workflows, which limit autonomous and global task completion. In this paper, we introduce DeepAgent, an end-to-end deep reasoning agent that performs autonomous thinking, tool discovery, and action execution within a single, coherent reasoning process. To manage long-horizon interactions, we introduce an autonomous memory folding mechanism that compresses past interactions into structured episodic, working, and tool memories, reducing error accumulation while preserving critical information. To teach general-purpose tool use efficiently and stably, we develop an end-to-end reinforcement learning strategy, namely ToolPO, that leverages LLM-simulated APIs and applies tool-call advantage attribution to assign fine-grained credit to the tool invocation tokens. Extensive experiments on eight benchmarks, including general tool-use tasks (ToolBench, API-Bank, TMDB, Spotify, ToolHop) and downstream applications (ALFWorld, WebShop, GAIA, HLE), demonstrate that DeepAgent consistently outperforms baselines across both labeled-tool and open-set tool retrieval scenarios. The code and demo are available at https://github.com/RUC-NLPIR/DeepAgent.

大模型代理工具调用自主推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。