提出新方法生成无状态环境下的多轮工具调用数据,提升模型泛化能力。
Simulating Complex Multi-Turn Tool Calling Interactions in Stateless Execution Environments
- 设计新型生成模式,隐式编码用户请求中的工具调用
- 在标准基准上实现强性能,优于传统有状态假设方法
- 适用于高安全要求或异构工具源的现实场景
合成数据已被证明是训练成本较低的语言模型以应对多轮工具调用对话复杂性的有效资源。尽管已有多种框架用于生成多轮工具调用数据,但以往工作通常假设工具调用发生在保持状态的执行环境中。当此类环境可用时,可通过执行环境状态是否匹配预设目标来判断交互有效性。然而,在许多实际场景中(如企业级数据安全要求严苛或工具规范来自多个来源),这一假设不成立。本文提出DiGiT-TC数据生成方法,旨在生成具有有状态环境生成特征的工具调用对话。其核心在于一种新颖的生成模式,可隐式表示用户请求中的部分工具调用。我们在标准工具调用基准上验证该方法,结果表明即使在有状态设定下,该方法仍带来显著性能提升。
原文摘要 · Abstract (English)
Synthetic data has proven itself to be a valuable resource for tuning smaller, cost-effective language models to handle the complexities of multi-turn tool calling conversations. While many frameworks and systems for producing synthetic multi-turn tool calling data have been proposed, prior works have frequently assumed that any tool calling interactions will take place in an execution environment that maintains state. When such an environment is available, this is advantageous as it allows for the validity of an interaction to be determined by whether or not the state of the execution environment matches to some prespecified objective. Unfortunately, this does not hold in many real-world tool use settings, e.g., in enterprise settings where data security is of the utmost importance or in cases where tool specifications are synthesized from multiple sources. In this work, we address this gap by introducing a data generation method, DiGiT-TC, that is designed to produce tool calling conversations that have the characteristics of conversations generated through search in a stateful environment. The key to our technique lies in a novel generation pattern that allows our approach to implicitly represent certain tool calls in the user request. We validate our approach on standard tool calling benchmarks and demonstrate that, even in stateful problem settings, our approach results in strong performance gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。