通过图结构约束检索,让大模型推理更连贯可靠。
Path-Constrained Retrieval: A Structural Approach to Reliable LLM Agent Reasoning Through Graph-Scoped Semantic Search
- 用知识图谱路径限制搜索范围,确保信息逻辑连贯。
- 在6个领域180个节点上,结构一致性达100%,基线仅24%-32%。
- 适合需要精准推理链的AI代理系统,如技术问答、复杂决策。
大型语言模型代理常从与当前推理状态缺乏结构一致性的知识库中检索信息,导致推理链条不连贯。我们提出路径约束检索(Path-Constrained Retrieval, PCR),结合结构图约束与语义搜索,确保检索信息在知识图谱中保持逻辑关系。PCR将搜索范围限定在从锚点可达的节点内,避免获取结构分离的信息,从而防止推理不一致。我们在PathRAG-6基准上进行评估,该基准涵盖六个领域,包含180个节点和360条边。结果表明,PCR实现100%的结构一致性,而基线方法仅为24%-32%;同时保持强相关性得分。在技术领域,PCR在排名10位时实现完全相关性与结构一致性,显著优于向量搜索和混合检索。相比基线,PCR将检索内容的平均图距离降低78%,证明其能更有效地检索结构一致的信息。这些发现表明,路径约束检索是提升大模型代理推理可靠性与连贯性的有效方法。
原文摘要 · Abstract (English)
Large Language Model agents often retrieve context from knowledge bases that lack structural consistency with the agent's current reasoning state, leading to incoherent reasoning chains. We introduce Path-Constrained Retrieval (PCR), a retrieval method that combines structural graph constraints with semantic search to ensure retrieved information maintains logical relationships within a knowledge graph. PCR restricts the search space to nodes reachable from an anchor node, preventing retrieval of structurally disconnected information that may lead to inconsistent reasoning. We evaluate PCR on PathRAG-6, a benchmark spanning six domains with 180 nodes and 360 edges. Our results show that PCR achieves full structural consistency compared to 24-32 percent in baseline methods, while maintaining strong relevance scores. On the technology domain, PCR obtains full relevance at rank 10 with full structural consistency, significantly outperforming vector search and hybrid retrieval. PCR reduces the average graph distance of retrieved context by 78 percent compared to baselines, demonstrating retrieval of more structurally consistent information. These findings suggest that path-constrained retrieval is an effective approach for improving the reliability and coherence of LLM agent reasoning systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。