让大模型更精准地找到合适工具,提升复杂任务解决能力。
Multi-Field Tool Retrieval
- 将工具功能拆解为多维度字段,精细匹配用户需求。
- 在五个数据集上达到当前最优性能,通用性更强。
- 适合需要高效调用外部工具的智能系统开发者。
引入外部工具使大型语言模型(LLMs)能够与真实环境交互并解决复杂任务。随着可用工具规模扩大,有效的工具检索对于缓解LLM上下文窗口限制并保证计算效率至关重要。现有方法通常将工具检索视为传统即席检索任务,将用户查询与完整的原始工具文档进行匹配。本文识别出该范式存在的三个根本挑战:(i) 工具文档不完整且结构不一致;(ii) 用户查询与技术文档之间存在显著语义和粒度差异;最重要的是,(iii) 工具实用性具有多方面特性,涉及功能、输入约束、输出格式等不同维度,其形式和重要性各不相同。为应对这些挑战,我们提出多字段工具检索框架,通过细粒度的多字段建模,实现用户意图与工具表征的对齐。实验结果表明,该框架在五个数据集和一个混合基准上均达到当前最优性能,展现出更强的泛化能力和鲁棒性。
原文摘要 · Abstract (English)
Integrating external tools enables Large Language Models (LLMs) to interact with real-world environments and solve complex tasks. Given the growing scale of available tools, effective tool retrieval is essential to mitigate constraints of LLMs' context windows and ensure computational efficiency. Existing approaches typically treat tool retrieval as a traditional ad-hoc retrieval task, matching user queries against the entire raw tool documentation. In this paper, we identify three fundamental challenges that limit the effectiveness of this paradigm: (i) the incompleteness and structural inconsistency of tool documentation; (ii) the significant semantic and granular mismatch between user queries and technical tool documents; and, most importantly, (iii) the multi-aspect nature of tool utility, that involves distinct dimensions, such as functionality, input constraints, and output formats, varying in format and importance. To address these challenges, we introduce Multi-Field Tool Retrieval, a framework designed to align user intent with tool representations through fine-grained, multi-field modeling. Experimental results show that our framework achieves SOTA performance on five datasets and a mixed benchmark, exhibiting superior generalizability and robustness.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。