arXiv:2511.18808cs.CLcs.AI2025-11被引 4

用双曲几何提升知识图谱检索,让大模型更懂层次化知识

HyperbolicRAG: Enhancing Retrieval-Augmented Generation with Hyperbolic Representations

  • 在双曲流形中建模节点,同时捕捉语义相似与层级包含关系
  • 跨抽象层级的对比正则化使结构一致性更强,准确率提升7.3%~12.1%
  • 融合欧氏与双曲空间的检索信号,适合复杂领域问答任务

检索增强生成(RAG)使大语言模型能够访问外部知识,缓解幻觉并提升专业能力。基于图的RAG通过显式关系组织增强结构推理能力,但传统方法依赖欧氏嵌入,难以表征知识图谱中的层次深度关系。为此,我们提出HyperbolicRAG,将双曲几何融入图基RAG框架。该方法包括:(1) 基于庞加莱流形的深度感知表示学习器,使语义相似性与层级包含对齐;(2) 无监督对比正则化,强化不同抽象层级间的几何一致性;(3) 互排序融合机制,联合利用欧氏与双曲空间的检索信号,推理时强调跨空间一致性。在多个QA基准上的实验证明,HyperbolicRAG显著优于标准RAG及图增强基线,性能提升达7.3%~12.1%。

原文摘要 · Abstract (English)

Retrieval-augmented generation (RAG) enables large language models (LLMs) to access external knowledge, helping mitigate hallucinations and enhance domain-specific expertise. Graph-based RAG enhances structural reasoning by introducing explicit relational organization that enables information propagation across semantically connected text units. However, these methods typically rely on Euclidean embeddings that capture semantic similarity but lack a geometric notion of hierarchical depth, limiting their ability to represent abstraction relationships inherent in complex knowledge graphs. To capture both fine-grained semantics and global hierarchy, we propose HyperbolicRAG, a retrieval framework that integrates hyperbolic geometry into graph-based RAG. HyperbolicRAG introduces three key designs: (1) a depth-aware representation learner that embeds nodes within a shared Poincare manifold to align semantic similarity with hierarchical containment, (2) an unsupervised contrastive regularization that enforces geometric consistency across abstraction levels, and (3) a mutual-ranking fusion mechanism that jointly exploits retrieval signals from Euclidean and hyperbolic spaces, emphasizing cross-space agreement during inference. Extensive experiments across multiple QA benchmarks demonstrate that HyperbolicRAG outperforms competitive baselines, including both standard RAG and graph-augmented baselines.

知识图谱双曲嵌入RAG层次结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。