用高阶超图提升多跳问答的推理能力,更准更快。
HyperRAG: Reasoning N-ary Facts over Hypergraphs for Retrieval Augmented Generation
- 基于超图构建多跳推理路径,支持高阶关系建模。
- 在多个数据集上平均提升MRR 2.95%,Hits@10提升1.23%。
- 适合需要复杂逻辑推理的开放域与闭域问答任务。
基于图的检索增强生成(RAG)方法通常依赖仅含二元关系事实的知识图谱,在多跳开放域问答中表现良好。但其固定的检索机制和密集相似度搜索常引入无关上下文,增加计算开销,并限制关系表达能力。相比之下,高阶超图能编码更丰富的实体间依赖关系,实现更浅层、高效的推理路径。为此,我们提出面向超图的HyperRAG框架,包含两种互补的检索变体:(i) HyperRetriever通过结构-语义联合推理,构建条件化的关联链,实现精准的事实追踪、自适应的高阶遍历和可解释的多跳推理;(ii) HyperMemory利用大模型参数化记忆引导束搜索,动态评分高阶事实与实体,实现查询感知的路径扩展。在WikiTopics(11个闭域数据集)及三个开放域问答基准(HotpotQA、MuSiQue、2WikiMultiHopQA)上的实验验证了HyperRAG的有效性。HyperRetriever在整体表现上达到最高准确率,平均相较最强基线提升MRR 2.95%、Hits@10 1.23%。定性分析显示,其通过自适应且可解释的高阶链构建,有效弥合推理断点,惠及开放域与闭域问答。
原文摘要 · Abstract (English)
Graph-based retrieval-augmented generation (RAG) methods, typically built on knowledge graphs (KGs) with binary relational facts, have shown promise in multi-hop open-domain QA. However, their rigid retrieval schemes and dense similarity search often introduce irrelevant context, increase computational overhead, and limit relational expressiveness. In contrast, n-ary hypergraphs encode higher-order relational facts that capture richer inter-entity dependencies and enable shallower, more efficient reasoning paths. To address this limitation, we propose HyperRAG, a RAG framework tailored for n-ary hypergraphs with two complementary retrieval variants: (i) HyperRetriever learns structural-semantic reasoning over n-ary facts to construct query-conditioned relational chains. It enables accurate factual tracking, adaptive high-order traversal, and interpretable multi-hop reasoning under context constraints. (ii) HyperMemory leverages the LLM's parametric memory to guide beam search, dynamically scoring n-ary facts and entities for query-aware path expansion. Extensive evaluations on WikiTopics (11 closed-domain datasets) and three open-domain QA benchmarks (HotpotQA, MuSiQue, and 2WikiMultiHopQA) validate HyperRAG's effectiveness. HyperRetriever achieves the highest answer accuracy overall, with average gains of 2.95% in MRR and 1.23% in Hits@10 over the strongest baseline. Qualitative analysis further shows that HyperRetriever bridges reasoning gaps through adaptive and interpretable n-ary chain construction, benefiting both open and closed-domain QA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。