arXiv:2512.17220cs.CL2025-12被引 6

让大模型像人一样理解长文档,通过全局语义引导检索与生成。

Mindscape-Aware Retrieval Augmented Generation for Improved Long Context Understanding

  • 构建分层摘要生成全局语义图谱,统一指导检索与生成
  • 在多语言长文本任务上超越基线,提升证据整合能力
  • 适合需要深度理解长文档的问答与推理场景

人类理解长而复杂的文本依赖于内容的整体语义表征,这种全局视角有助于组织先验知识、解释新信息并整合分散在文档中的证据。当前检索增强生成(RAG)系统缺乏此类引导,难以处理长上下文任务。本文提出首个将心智景观感知融入检索与生成的框架——MiA-RAG,通过分层摘要构建全局语义表示,并将其作为统一条件用于检索与生成过程。该机制使检索器能生成更丰富的查询嵌入,生成器能在连贯的全局上下文中推理所获取的证据。我们在多种长文本与双语基准上评估了MiA-RAG,结果表明其持续优于基线,且分析显示其能有效将局部细节与全局语义对齐,实现更接近人类的长文本理解与推理能力。

原文摘要 · Abstract (English)

Humans understand long and complex texts by relying on a holistic semantic representation of the content. This global view helps organize prior knowledge, interpret new information, and integrate evidence dispersed across a document, as revealed by the Mindscape-Aware Capability of humans in psychology. Current Retrieval-Augmented Generation (RAG) systems lack such guidance and therefore struggle with long-context tasks. In this paper, we propose Mindscape-Aware RAG (MiA-RAG), the first framework to formulate mindscape-aware retrieval and generation as a unified conditioning paradigm for LLM-based RAG. MiA-RAG builds a mindscape through hierarchical summarization and conditions both retrieval and generation on this global semantic representation. This enables the retriever to form enriched query embeddings and the generator to reason over retrieved evidence within a coherent global context. We evaluate MiA-RAG across diverse long-context and bilingual benchmarks for evidence-based understanding and global sense-making. It consistently surpasses baselines, and further analysis shows that it aligns local details with a coherent global representation, enabling more human-like long-context retrieval and reasoning.

长文本理解检索增强语义对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。