从文本中生成真实多步工具使用轨迹,提升大模型自主能力。
Unlocking Implicit Experience: Synthesizing Tool-Use Trajectories from Text
- 通过四阶段流程从文本中提取多步工具使用路径
- GEM-32B在基准上提升16.5%,接近专用数据训练效果
- 轻量合成器实现高效生成,推理延迟显著降低
让大语言模型在多轮交互中有效使用工具,是构建智能自主代理的关键。然而,获取多样且真实的多轮工具使用数据仍面临挑战。本文提出一种基于文本的新范式:文本语料库天然包含丰富的多步问题解决经验,可作为未被利用的、可扩展且真实的多轮工具使用数据来源。基于此,我们提出GEM数据合成管道,通过四个阶段——相关性过滤、工作流与工具提取、轨迹锚定、复杂度优化——从文本中生成并提取多轮工具使用轨迹。为降低计算成本,我们进一步通过监督微调训练了一个专用的轨迹合成器,将复杂生成流程压缩为高效的端到端生成模型。实验表明,GEM-32B在BFCL V3多轮基准上提升16.5%;其性能部分超越在τ-bench(Airline和Retail)领域数据上训练的模型,凸显了该文本合成范式的优越泛化能力。值得注意的是,轨迹合成器在保持高生成质量的同时,显著降低推理延迟与成本。
原文摘要 · Abstract (English)
Enabling Large Language Models (LLMs) to effectively utilize tools in multi-turn interactions is essential for building capable autonomous agents. However, acquiring diverse and realistic multi-turn tool-use data remains a significant challenge. In this work, we propose a novel text-based paradigm. We observe that textual corpora naturally contain rich, multi-step problem-solving experiences, which can serve as an untapped, scalable, and authentic data source for multi-turn tool-use tasks. Based on this insight, we introduce GEM, a data synthesis pipeline that enables the generation and extraction of multi-turn tool-use trajectories from text corpora through a four-stage process: relevance filtering, workflow & tool extraction, trajectory grounding, and complexity refinement. To reduce the computational cost, we further train a specialized Trajectory Synthesizer via supervised fine-tuning. This model distills the complex generation pipeline into an efficient, end-to-end trajectory generator. Experiments demonstrate that our GEM-32B achieve a 16.5% improvement on the BFCL V3 Multi-turn benchmark. Our models partially surpass the performance of models trained on τ - bench (Airline and Retail) in-domain data, highlighting the superior generalization capability derived from our text-based synthesis paradigm. Notably, our Trajectory Synthesizer matches the quality of the full pipeline while significantly reducing inference latency and costs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。