arXiv:2605.29561cs.AIcs.SE2026-05

让大模型用参数化工具代替文档调用,提速降耗还更准。

ParaTool: Shifting Tool Representations from Context to Parameters

论文配图:ParaTool: Shifting Tool Representations from Context to Parameters
图 1 · 摘自论文原文
  • 把工具知识转成可加载的参数模块,不再依赖上下文文档
  • 在Stable ToolBench上比主流方法提升12.3%,推理速度加快40%
  • 适合需要高效调用多个外部工具的智能系统开发者

工具调用通过连接外部可执行接口,拓展了大语言模型的环境交互能力。然而,主流的上下文学习方法常将详细工具文档和使用示例直接放入上下文,导致推理开销大且易产生幻觉。尽管基于微调的方法提升了通用调用能力,却难以内化具体工具细节,仍依赖上下文文档。为此,我们提出ParaTool框架,将每个工具映射为独立、可加载的参数集合。通过动态整合这些参数化工具,大模型可在不依赖上下文文档或示例的情况下完成调用。该方法包含三个阶段:(1)参数化工具预训练,将不同工具的知识封装为独立参数模块;(2)软工具选择,通过门控网络动态加权并聚合相关工具参数;(3)参数化工具微调,联合更新工具参数以对齐训练与推理过程。在Stable ToolBench和BFCL上的实验表明,ParaTool显著优于强基线ICL方法,在性能提升的同时降低计算复杂度。

原文摘要 · Abstract (English)

Tool calling extends large language models (LLMs) by enabling grounded interaction with external executable interfaces, thereby supporting environment-coupled problem solving. However, mainstream in-context learning (ICL) approaches typically incorporate detailed tool documentation and usage examples directly into the context. This results in substantial inference overhead and heightened risks of hallucination as the context length grows. Conversely, while tuning-based methods improve general tool-calling capabilities, they often fail to effectively internalize the specific details of previously seen tools, thereby retaining a dependency on in-context documentation. To address these limitations, we propose ParaTool, a framework that projects each tool into a dedicated, loadable set of parameters. By equipping a dynamic integration of these parameterized tools, the LLM can perform tool calling without relying on in-context documents or examples. Specifically, our approach consists of three stages: (1) parametric tool pre-training encapsulates the knowledge of different tools into independent parameter modules; (2) soft tool selection employs a gating network to dynamically weigh and aggregate relevant tool parameters; and (3) parametric tool fine-tuning jointly updates tool parameters to align the training and inference processes. Experiments on Stable ToolBench and BFCL demonstrate that ParaTool significantly outperforms strong ICL-based baselines, achieving superior performance while reducing computational complexity.

工具调用参数化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。