让大模型自主探索知识图谱,自动调节广度与深度检索。
Autonomous Knowledge Graph Exploration with Adaptive Breadth-Depth Retrieval
- 用全局关键词搜索和邻域遍历两种操作动态平衡检索广度与深度。
- 在STaRK数据集上Hit@1达59.1%,比现有方法提升最高31.4%。
- 适用于需要多跳推理的复杂查询,适合无训练的智能体应用。
从知识图谱中为语言模型查询检索证据,需在广泛覆盖与多跳关系追踪之间权衡。基于相似性的检索器虽覆盖面广但深度不足,而基于遍历的方法依赖种子节点选择,当查询跨越多个实体与关系时易失败。我们提出ARK:自适应知识检索器,赋予语言模型对广度-深度权衡的控制力,通过全局词汇搜索和单跳邻域探索两种操作组合实现多跳遍历。ARK无需依赖脆弱的种子选择、预设跳数或检索训练,能根据查询类型自动调整策略:语言密集型查询使用全局搜索,关系密集型则采用邻域扩展。在STaRK数据集上,平均Hit@1达59.1%,平均MRR为67.4,相比基于检索和基于代理的免训练方法,分别提升最高31.4%和28.0%。最后,我们通过无标签模仿学习,将大型教师模型的工具使用轨迹蒸馏至8B模型,在AMAZON、MAG、PRIME数据集上,其Hit@1分别提升7.0、26.6、13.5个绝对百分点,同时保留高达98.5%的教师模型性能。
原文摘要 · Abstract (English)
Retrieving evidence for language model queries from knowledge graphs requires balancing broad search across the graph with multi-hop traversal to follow relational links. Similarity-based retrievers provide coverage but remain shallow, whereas traversal-based methods rely on selecting seed nodes to start exploration, which can fail when queries span multiple entities and relations. We introduce ARK: Adaptive Retriever of Knowledge, a tool-using KG retriever that gives a language model control over this breadth-depth tradeoff using a two-operation toolset: global lexical search over node descriptors and one-hop neighborhood exploration that composes into multi-hop traversal. ARK alternates between breadth-oriented discovery and depth-oriented expansion without depending on a fragile seed selection, a pre-set hop depth, or requiring retrieval training. ARK adapts tool use to queries, using global search for language-heavy queries and neighborhood exploration for relation-heavy queries. On STaRK, ARK reaches 59.1% average Hit@1 and 67.4 average MRR, improving average Hit@1 by up to 31.4% and average MRR by up to 28.0% over retrieval-based and agent-based training-free methods. Finally, we distill ARK's tool-use trajectories from a large teacher into an 8B model via label-free imitation, improving Hit@1 by +7.0, +26.6, and +13.5 absolute points over the base 8B model on AMAZON, MAG, and PRIME datasets, respectively, while retaining up to 98.5% of the teacher's Hit@1 rate.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。