arXiv:2602.20426cs.AI2026-02被引 2

让大模型学会自动优化工具描述,提升智能体在复杂工具环境中的可靠性。

Learning to Rewrite Tool Descriptions for Reliable LLM-Agent Tool Use

  • 通过无轨迹训练框架,让模型从高质量描述中学习通用有效模式。
  • 工具数量达150+时,成功率提升60.89%,准确率下降减少29.23%。
  • 无需重新训练即可跨领域泛化,适合需要稳定工具调用的部署场景。

当前多数提升基于大模型的工具使用智能体的研究聚焦于模型本身——如使用更大模型、优化提示或微调,但随着工具接口质量成为瓶颈,性能逐渐趋于饱和。现有工具描述通常面向人类开发者,容忍模糊性,而智能体无法处理,尤其在候选工具增多时更为明显。现有改进方法需为每新增接口重复多阶段流程(生成查询、执行智能体收集轨迹、标注轨迹、多次调用强模型),且独立优化每个工具,难以扩展和泛化。本文提出Trace-Free+,一种渐进式迁移的课程学习框架,将监督信号从有轨迹的训练环境逐步转移到无轨迹的部署环境,促使模型内化有效工具描述的通用规律。为支持该方法,我们通过严谨的数据合成流程构建了一个大规模高质量工具接口数据集,源自真实API。在主流基准测试中,实验表明Trace-Free+在工具目录扩展至150+时显著提升鲁棒性:在StableToolBench上,准确率下降减少29.23%,查询级成功率平均提升60.89%;具备跨领域泛化能力,无需重训,并可与智能体微调产生互补增益。

原文摘要 · Abstract (English)

While most efforts to improve LLM-based tool-using agents focus on the agent itself - through larger models, better prompting, or fine-tuning - agent performance increasingly plateaus due to the quality of the tool interfaces these agents consume. Tool descriptions are often written for human developers and tolerate ambiguity that agents cannot resolve, particularly as the number of candidate tools grows. Existing approaches to improving tool interfaces (1) require re-running a multi-stage per-tool pipeline - synthesizing queries, executing an agent to collect trajectories, annotating trajectories, and prompting a strong LLM multiple times - for every API that enters the catalog, and (2) typically optimize each tool independently, limiting scalability and generalization to unseen tools. We propose Trace-Free+, a curriculum learning framework that progressively transfers supervision from trace-rich settings to trace-free deployment, encouraging the model to internalize reusable patterns of what makes a tool description effective. To support this approach, we construct a large-scale dataset of high-quality tool interfaces derived from real-world APIs through a principled data synthesis workflow. Experiments on widely adopted benchmarks show that Trace-Free+ improves robustness as tool catalogs scale to 150+ candidates - in scaling experiments, reducing accuracy degradation by 29.23% and improving average query-level success by 60.89% on StableToolBench - generalizes across domains without retraining, and provides complementary gains on top of agent fine-tuning.

智能体工具调用大模型泛化能力

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。