通过整合经验知识提升大模型工具调用能力,解决多步任务失败问题。
Pushing the Limits of LLM Tool Calling via Experiential Knowledge Integration and Activation

- 用实例级经验知识替代抽象意图,更有效提升工具使用性能。
- 并行采样聚合推理宽度,比深度推理更高效激活隐藏知识。
- 结合增强训练与宽推理框架,适配不同规模模型的自主执行。
大语言模型依赖工具执行以成为自主代理,但在多步任务中常因工具相关知识不足和知识激活无效而失败。本文系统研究知识对工具使用性能的影响,涵盖知识获取、激活与内化三个阶段。在知识获取阶段,分析表明实例级知识即可带来显著且可靠提升,而抽象意图级知识收益有限。推理时,深度推理提示效果递减,而通过并行采样与聚合扩展推理宽度能更有效激活潜在经验知识。训练时,采用知识增强数据进行后训练,强化学习优于监督微调。基于上述发现,提出知识增强型工具执行框架KATE,融合经验知识、宽推理推理与知识感知训练。在BFCL-V3和AppWorld数据集上的实验显示,该方法在不同模型规模下均显著优于强基线。代码已开源:https://github.com/hypasd-art/KATE。
原文摘要 · Abstract (English)
Large language models (LLMs) rely on tool use to act as autonomous agents, yet often fail in multi-step execution due to insufficient tool-related knowledge and ineffective knowledge activation. Therefore, we present a systematic study on how knowledge influences tool-use performance, covering the stages of knowledge acquisition, activation, and internalization. In the knowledge acquisition stage, we acquire and evaluate various forms of experiential knowledge, and our analysis shows that simple instance-level knowledge can already provide strong and reliable gains, while abstract intent-level knowledge offers limited benefits. At inference time, to activate knowledge, we find that prompting LLM to expand the depth of reasoning yields diminishing returns, whereas expanding the width of reasoning by parallel sampling with aggregation more effectively activates latent experiential knowledge. At training time, for knowledge internalization, post-training with knowledge-augmented data further improves performance, with reinforcement learning outperforming supervised fine-tuning. Based on these insights, we propose the Knowledge-Augmented Tool Execution (KATE), a knowledge-augmented tool execution framework that integrates experiential knowledge with reasoning-width-expanded inference and knowledge-aware training. Experiments on BFCL-V3 and AppWorld demonstrate consistent and substantial improvements over strong baselines across model scales. Our Code is available at https://github.com/hypasd-art/KATE.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。