用图结构增强大模型工具规划,解决依赖缺失问题
GTool: Graph Enhanced Tool Planning with Large Language Model
- 构建请求专属工具图,显式建模工具间依赖关系
- 在7B模型上提升超29.6%,优于当前最佳基线
- 无需重训练,可无缝接入各类大模型
大语言模型的工具规划旨在根据用户请求选择、组织并准备所需工具,连接自然语言理解与任务执行。现有方法将工具视为孤立组件,忽视其内在依赖,导致规划结果无效。尤其在工具集庞大且依赖信息不完整时,准确识别所需工具尤为困难。为此,我们提出 exttt{GTool},首个针对不完整依赖场景增强大模型工具规划能力的方法。 exttt{GTool} 构建请求特定的工具图,高效选择工具并生成 exttt{<graph token>},向大模型提供可理解的依赖信息。此外,设计缺失依赖预测任务以提升可靠性。无需微调大模型, exttt{GTool} 可无缝集成于多种大模型主干,无需大量重训练。大量实验表明,相较于当前最优基线, exttt{GTool} 在轻量级(7B)模型上实现超过29.6%的性能提升。
原文摘要 · Abstract (English)
Tool planning with large language models (LLMs), referring to selecting, organizing, and preparing the tools necessary to complete a user request, bridges the gap between natural language understanding and task execution. However, current works treat different tools as isolated components and fail to leverage the inherent dependencies of tools, leading to invalid planning results. Since tool dependencies are often incomplete, it becomes challenging for LLMs to accurately identify the appropriate tools required by a user request, especially when confronted with a large toolset. To solve this challenge, we propose \texttt{GTool}, which is the first work aiming to enhance the tool planning ability of LLMs under incomplete dependencies. \texttt{GTool} constructs a request-specific tool graph to select tools efficiently and generate the \texttt{<graph token>} which provides sufficient dependency information understandable by LLMs. Moreover, a missing dependency prediction task is designed to improve the reliability of \texttt{GTool} with incomplete dependencies. Without trimming LLMs, \texttt{GTool} can be seamlessly integrated with various LLM backbones without extensive retraining. Extensive experiments show that \texttt{GTool} achieves more than 29.6\% performance improvements compared with the state-of-the-art (SOTA) baselines with a light-weight (7B) LLM backbone.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。