arXiv:2508.05888cs.AIcs.IR2025-08

用知识图谱提升企业任务规划中的工具检索准确率

Planning Agents on an Ego-Trip: Leveraging Hybrid Ego-Graph Ensembles for Improved Tool Retrieval in Enterprise Task Planning

  • 构建多跳自指图集合,捕捉工具间的直接与间接依赖关系
  • 在六类用户任务上实现91.85%的工具覆盖,优于基线2.59个百分点
  • 适合需要多步工具组合的企业级AI规划系统开发者

在复杂用户查询背景下,高效进行工具预筛选对AI代理选择合适工具至关重要。尽管这一环节在规划中占据核心地位,但现有研究仍显不足。传统方法主要依赖用户查询与工具描述之间的相似性,严重限制了多步请求下的检索精度。为此,我们提出一种基于知识图谱(KG)的工具检索框架,用于建模工具间的语义关系及其功能依赖。检索算法利用1跳自指工具图的集成结构,刻画工具间的直接与间接连接,实现更全面、更具上下文感知的多步任务工具选择。我们在一个内部合成数据集上进行了评估,涵盖六类用户场景,扩展了此前关于连贯对话生成与工具检索基准的工作。结果表明,该图结构方法在微平均完整召回率(CompleteRecall)上达到91.85%,显著优于非KG最强基线(重排序语义词法混合检索)的89.26%。这些发现支持我们的假设:图结构所建模的拓扑信息可为纯相似性匹配提供互补信号,尤其在需要顺序工具组合的查询中表现突出。

原文摘要 · Abstract (English)

Effective tool pre-selection via retrieval is essential for AI agents to select from a vast array of tools when identifying and planning actions in the context of complex user queries. Despite its central role in planning, this aspect remains underexplored in the literature. Traditional approaches rely primarily on similarities between user queries and tool descriptions, which significantly limits retrieval accuracy, specifically when handling multi-step user requests. To address these limitations, we propose a Knowledge Graph (KG)-based tool retrieval framework that captures the semantic relationships between tools and their functional dependencies. Our retrieval algorithm leverages ensembles of 1-hop ego tool graphs to model direct and indirect connections between tools, enabling more comprehensive and contextual tool selection for multi-step tasks. We evaluate our approach on a synthetically generated internal dataset across six defined user classes, extending previous work on coherent dialogue synthesis and tool retrieval benchmarks. Results demonstrate that our tool graph-based method achieves 91.85% tool coverage on the micro-average CompleteRecall metric, compared to 89.26% for re-ranked semantic-lexical hybrid retrieval, the strongest non-KG baseline in our experiments. These findings support our hypothesis that the structural information modeled in the graph provides complementary signals to pure similarity matching, particularly for queries requiring sequential tool composition.

知识图谱工具检索任务规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。