arXiv:2601.17755cs.CL2026-01被引 2

用结构感知的超图检索提升大模型多跳推理能力

HyperGraphPro: Progress-Aware Reinforcement Learning for Structure-Guided Hypergraph RAG

  • 构建超图联合语义与拓扑信息,引导连贯多跳推理路径
  • 基于中间进展动态调整奖励,实现细粒度策略优化
  • 在多跳问答任务上显著优于现有图检索方法

图检索增强生成(GraphRAG)将外部知识组织为实体与关系的结构化图,使大语言模型(LLMs)能够进行超越文本块检索的复杂推理。近期研究将强化学习(RL)引入代理式GraphRAG,实现训练过程中与知识图谱的迭代交互。然而,现有方法存在两大局限:(1) 主要依赖语义相似性进行检索,忽略底层图拓扑结构;(2) 仅使用稀疏的结果级奖励,无法捕捉中间检索步骤的质量及其依赖关系。为此,我们提出HyperGraphPro,一种面向结构引导的进度感知强化学习框架。该方法引入结构感知的超图检索机制,同时考虑语义相关性和图连通性,促进沿多跳推理路径的连贯遍历。此外,设计基于进展的分步策略优化,通过根据图内中间推理进展调节优势值,而非仅依赖最终结果提供密集学习信号。在多跳问答基准测试中,HyperGraphPro持续提升推理准确率与生成质量,优于现有GraphRAG方法。

原文摘要 · Abstract (English)

Graph Retrieval-Augmented Generation (GraphRAG) has emerged as a promising paradigm that organizes external knowledge into structured graphs of entities and relations, enabling large language models (LLMs) to perform complex reasoning beyond text-chunk retrieval. Recent advances have integrated reinforcement learning (RL) into agentic GraphRAG approaches, enabling iterative interactions with knowledge graphs during training. However, existing RL-based methods suffer from two key limitations: (1) they primarily depend on semantic similarity for retrieval, often overlooking the underlying graph topology, and (2) they rely on sparse, outcome-level rewards that fail to capture the quality of intermediate retrieval steps and their dependencies. To address these limitations, we propose HyperGraphPro, a progress-aware agentic framework for graph-based retrieval and multi-step reasoning. HyperGraphPro introduces a structure-aware hypergraph retrieval mechanism that jointly considers semantic relevance and graph connectivity, promoting coherent traversal along multi-hop reasoning paths. Furthermore, we design a progress-based stepwise policy optimization that provides dense learning signals by modulating advantages according to intermediate reasoning progress within a graph, rather than relying solely on final outcomes. Experiments on multi-hop question answering benchmarks demonstrate that HyperGraphPro consistently improves reasoning accuracy and generation quality over existing GraphRAG methods.

图检索多跳推理强化学习大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。