arXiv:2512.23959cs.CLcs.AI2025-12被引 4

用超图构建动态记忆,提升长文本多步推理能力

HGMEM: Hypergraph-based Working Memory to Improve Multi-step RAG for Long-Context Complex Relational Modeling

  • 用超图结构表示记忆,捕捉事实间的高阶关联
  • 在多个基准上显著优于现有方法,提升多步推理准确率
  • 适合需要深度推理和全局理解的复杂任务场景

多步检索增强生成(RAG)已成为提升大语言模型在需要全局理解与复杂推理任务表现的主流策略。尽管现有RAG系统引入工作记忆以整合信息,但其设计多为被动存储孤立事实的静态结构,忽略了原始事实间的关键高阶关联,限制了模型的多步推理能力,导致推理碎片化和长上下文中的全局理解薄弱。本文提出HGMem,一种基于超图的工作记忆系统,将记忆从简单存储拓展为支持复杂推理与全局理解的动态表达结构。在该方法中,记忆以超图形式表示,超边对应不同的记忆单元,实现记忆内部高阶关系的渐进式构建。该机制连接围绕核心问题的事实与思维,使记忆演化为集成且情境化的知识结构,为深层推理提供有力支撑。我们在多个具有挑战性的全局理解基准上评估HGMem。大量实验与深入分析表明,该方法持续提升多步RAG性能,在多种数据集上显著超越强基线系统。

原文摘要 · Abstract (English)

Multi-step retrieval-augmented generation (RAG) has become a widely adopted strategy for enhancing large language models (LLMs) on tasks that demand global comprehension and intensive reasoning. Although many RAG systems incorporate a working memory to consolidate information, existing designs primarily function as a passive storage for isolated facts. This static nature overlooks crucial high-order correlations among primitive facts, thereby limiting models' capacity for multi-step reasoning and resulting in fragmented reasoning and weak global sense-making within extended contexts. We introduce HGMem, a hypergraph-based working memory system, extending the concept of memory beyond simple storage into a dynamic, expressive structure for complex reasoning and global understanding. In our approach, memory is represented as a hypergraph where hyperedges correspond to distinct memory units, enabling the progressive formation of high-order interactions within memory. This mechanism connects facts and thoughts around the focal problem, evolving the memory into an integrated and situated knowledge structure that provides strong propositions for deeper reasoning. We evaluate HGMem on several challenging global sense-making benchmarks. Extensive experiments and in-depth analyses demonstrate that our method consistently improves multi-step RAG and substantially outperforms strong baseline systems across diverse datasets.

多步推理工作记忆超图RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。