统一工具调用的表示、数据与评估,提升大模型工具使用能力
UniToolCall: Unifying Tool-Use Representation, Data, and Evaluation for LLM Agents

- 构建统一框架,标准化工具调用全流程
- 在39万+样本上训练,单轮严格准确率达93.0%
- 支持多轮推理依赖建模,适合工具调用研究者使用
工具调用是大模型智能体的核心能力,使其可通过结构化函数调用与外部系统交互。然而现有研究在交互表示上不一致,忽视工具调用轨迹的结构分布,且评估基准不兼容。本文提出UniToolCall,一个统一的工具学习框架,涵盖工具集构建、数据生成到评估的全链条标准化。该框架整合22,000+工具,构建包含390,000+实例的混合训练语料,融合10个标准化公开数据集与结构可控的合成轨迹。显式建模单跳/多跳、单轮/多轮及串行/并行执行模式,并引入锚点关联机制以支持跨轮推理依赖。将7个公开评测基准统一转化为细粒度的查询-动作-观察-回答(QAOA)格式,在函数调用、轮次和对话层级进行评估。实验表明,基于该数据集微调Qwen3-8B显著提升工具调用性能,在干扰密集的Hybrid-20设置下,单轮严格准确率达93.0%,超越GPT、Gemini和Claude等商用模型。
原文摘要 · Abstract (English)
Tool-use capability is a fundamental component of LLM agents, enabling them to interact with external systems through structured function calls. However, existing research exhibits inconsistent interaction representations, largely overlooks the structural distribution of tool-use trajectories, and relies on incompatible evaluation benchmarks. We present UniToolCall, a unified framework for tool learning that standardizes the entire pipeline from toolset construction and dataset generation to evaluation. The framework curates a large tool pool of 22k+ tools and constructs a hybrid training corpus of 390k+ instances by combining 10 standardized public datasets with structurally controlled synthetic trajectories. It explicitly models diverse interaction patterns, including single-hop vs. multi-hop and single-turn vs. multi-turn, while capturing both serial and parallel execution structures. To support coherent multi-turn reasoning, we further introduce an Anchor Linkage mechanism that enforces cross-turn dependencies. Furthermore, we convert 7 public benchmarks into a unified Query--Action--Observation--Answer (QAOA) representation with fine-grained evaluation at the function-call, turn, and conversation levels. Experiments show that fine-tuning Qwen3-8B on our dataset substantially improves tool-use performance. Under the distractor-heavy Hybrid-20 setting, achieves 93.0% single-turn Strict Precision, outperforming commercial models including GPT, Gemini, and Claude.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。