arXiv:2607.14145cs.AIcs.CV2026-07被引 2

让智能体学会用新工具,突破旧习惯束缚。

ToolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capability

论文配图:ToolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capability
图 1 · 摘自论文原文
  • 在关键决策点注入假设性反事实情境,打破使用旧工具的惯性
  • 在多个任务上实现扩展工具集下的稳定性能,避免重新训练
  • 适合需要动态适应新工具的智能体系统研发人员

具备工具增强能力的大语言模型智能体在长周期任务中表现优异,但通常在固定工具集上进行后训练。当任务需要新增工具时,这些智能体难以有效引入新工具,而从头重新训练又常不切实际。我们发现工具集扩展的核心障碍是行为惯性:即使有新工具可用,智能体仍倾向于依赖熟悉的工具和既有推理模式。实验表明,在关键决策点注入反事实锚定上下文,可打破这种惯性,激活被抑制的潜在能力,恢复失败的任务轨迹。为此,我们提出 ToolAnchor 框架,利用教师模型生成反事实上下文,通过学生模型回放验证,并以智能体后训练方式内化成功干预策略。在通用智能助手(GAIA)、文本搜索(BrowseComp)和视觉搜索(VDR-Bench)任务上的大量评估显示,ToolAnchor 在扩展工具集下始终表现出色。本工作弥合了静态后训练与动态适应之间的差距,为可扩展的智能体强化学习开辟了新路径。

原文摘要 · Abstract (English)

Tool-augmented large language model agents excel at long-horizon tasks, yet they are typically post-trained on fixed toolsets. When tasks demand new tools, these agents struggle to incorporate them effectively, and retraining from scratch is often impractical. We identify the core obstacle in such toolset expansion problem as behavioral inertia: the tendency of agents to fall back on familiar tools and established reasoning patterns despite having access to new ones. We demonstrate that injecting counterfactual anchor contexts at critical decision points can break this inertia, recovering failed trajectories by eliciting suppressed agent capabilities. To scale this insight, we propose ToolAnchor, a framework that uses teacher models to hypothesize these counterfactual contexts, verifies them via student rollouts, and internalizes the successful interventions through agentic post-training. Extensive evaluations across general AI assistant (GAIA), textual search (BrowseComp), and visual search (VDR-Bench) tasks demonstrate that ToolAnchor consistently exhibits competitive performance under expanded toolsets. Our work bridges the gap between static post-training and dynamic adaptation, charting a new path for scalable agentic reinforcement learning.

智能体工具使用反事实自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。