开源工具数据集ToolBridge,帮助大模型学会调用外部工具提升推理能力。
ToolBridge: An Open-Source Dataset to Equip LLMs with External Tool Capabilities
- 基于公开数据集筛选并构建工具调用训练数据
- 模型在标准与自建测试集上表现显著提升
- 适合研究大模型工具集成与数据构建的开发者
通过集成外部工具,GPT-4o和Llama 3.1等大语言模型显著拓展了功能,从对话助手进化为通用助手。我们认为,这类进展的核心驱动力是训练数据的质量与多样性。然而,现有具备工具集成能力的LLM对数据集和收集方法透明度不足,促使本研究开展。本文提出ToolBridge,旨在公开详细的数据构建流程。ToolBridge采用一系列通用开放数据集作为原始数据池,并通过策略筛选适配外部工具API插入的数据条目。通过对这些精炼数据进行监督微调,大模型可在合适场景中调用工具,提升预测准确率,尤其在数据处理、数值计算和事实检索等基础功能上表现突出。实验严格控制模型架构与训练配置,仅考察数据作用。结果表明,使用ToolBridge训练的模型在标准基准与自定义评估数据集上均实现稳定性能提升。所有代码与数据将开源至https://github.com/CharlesPikachu/ToolBridge,推动透明化研究,助力社区探索大模型工具集成方法。
原文摘要 · Abstract (English)
Through the integration of external tools, large language models (LLMs) such as GPT-4o and Llama 3.1 significantly expand their functional capabilities, evolving from elementary conversational agents to general-purpose assistants. We argue that the primary drivers of these advancements are the quality and diversity of the training data. However, the existing LLMs with external tool integration provide only limited transparency regarding their datasets and data collection methods, which has led to the initiation of this research. Specifically, in this paper, our objective is to elucidate the detailed process involved in constructing datasets that empower LLMs to effectively learn how to utilize external tools and make this information available to the public through the introduction of ToolBridge. ToolBridge proposes to employ a collection of general open-access datasets as its raw dataset pool and applies a series of strategies to identify appropriate data entries from the pool for external tool API insertions. By supervised fine-tuning on these curated data entries, LLMs can invoke external tools in appropriate contexts to boost their predictive accuracy, particularly for basic functions including data processing, numerical computation, and factual retrieval. Our experiments rigorously isolates model architectures and training configurations, focusing exclusively on the role of data. The experimental results indicate that LLMs trained on ToolBridge demonstrate consistent performance improvements on both standard benchmarks and custom evaluation datasets. All the associated code and data will be open-source at https://github.com/CharlesPikachu/ToolBridge, promoting transparency and facilitating the broader community to explore approaches for equipping LLMs with external tools capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。