arXiv:2502.18990cs.CL2025-02ACL被引 9

让大模型学会零样本用新工具、弱工具变强工具,提升实际应用能力。

GenTool: Enhancing Tool Generalization in Language Models through Zero-to-One and Weak-to-Strong Simulation

  • 通过模拟零到一、弱到强场景生成训练数据
  • 在四个场景中性能超越GPT-4o,1B~8B模型均有效
  • 适合需要灵活调用工具的AI助手开发场景

大型语言模型(LLMs)可通过集成外部工具扩展能力,获取更广泛信息。尽管当前模型常在监督微调(SFT)阶段使用工具示例进行训练,但其在未见查询与工具上的泛化能力仍存疑问。本文提出GenTool训练框架,针对真实应用中的两大核心挑战:零到一泛化(初始无适配工具时,模型可引入并使用新工具)与弱到强泛化(利用增强版工具解决任务)。我们构建了模拟这两种泛化的合成训练数据,并采用两阶段微调策略:先优化工具排序,再精炼工具选择。在涵盖四种泛化场景的实验中,该方法显著提升了1B至8B参数规模模型的工具使用能力,性能超过GPT-4o。分析还揭示了模型在工具泛化中的关键挑战。

原文摘要 · Abstract (English)

Large Language Models (LLMs) can enhance their capabilities as AI assistants by integrating external tools, allowing them to access a wider range of information. While recent LLMs are typically fine-tuned with tool usage examples during supervised fine-tuning (SFT), questions remain about their ability to develop robust tool-usage skills and can effectively generalize to unseen queries and tools. In this work, we present GenTool, a novel training framework that prepares LLMs for diverse generalization challenges in tool utilization. Our approach addresses two fundamental dimensions critical for real-world applications: Zero-to-One Generalization, enabling the model to address queries initially lacking a suitable tool by adopting and utilizing one when it becomes available, and Weak-to-Strong Generalization, allowing models to leverage enhanced versions of existing tools to solve queries. To achieve this, we develop synthetic training data simulating these two dimensions of tool usage and introduce a two-stage fine-tuning approach: optimizing tool ranking, then refining tool selection. Through extensive experiments across four generalization scenarios, we demonstrate that our method significantly enhances the tool-usage capabilities of LLMs ranging from 1B to 8B parameters, achieving performance that surpasses GPT-4o. Furthermore, our analysis also provides valuable insights into the challenges LLMs encounter in tool generalization.

工具调用模型泛化微调框架LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。