arXiv:2606.10921cs.CL2026-06

提出可按需构建图结构记忆的多智能体框架,提升长文档问答的推理效率与准确性。

Trace Only What You Need: Structure-Aware On-Demand Hypergraph Memory for Long-Document Question Answering

论文配图:Trace Only What You Need: Structure-Aware On-Demand Hypergraph Memory for Long-Document Question Answering
图 1 · 摘自论文原文
  • 基于查询触发构建动态超图工作记忆,融合文档层级结构
  • 在四个数据集上相比最强基线平均提升16.91% F1和15.50% EM
  • 支持历史推理经验复用,适合需要跨段落推理的复杂问答场景

长文档问答(QA)要求大语言模型(LLMs)在冗长文档中推理分散的证据,答案常依赖事件顺序、章节级上下文及跨部分证据关联。尽管检索增强生成(RAG)通过召回相关证据减少了输入上下文,现有结构化RAG方法仍存在三大局限:代价高昂的无查询感知知识组织、未能充分利用原始文档结构、缺乏历史推理经验复用。为此,我们提出DocTrace,一种支持查询触发知识组织、文档结构感知且经验引导的多智能体RAG框架。DocTrace以轻量级文档结构树索引保留文档层级,推理时按需构建智能体共享的超图结构工作记忆,并将成功推理路径存入图结构经验记忆供未来复用,实现对相关长文档问题的自适应探索。在四个长文档QA数据集上的实验表明,DocTrace在开放形式问答基准上相比最强基线ComoRAG平均提升16.91% F1和15.50% EM,NarrativeQA上最高分别提升20.67%和23.78%。

原文摘要 · Abstract (English)

Long-document question answering (QA) requires large language models (LLMs) to reason over evidence scattered across lengthy documents, where answers often depend on event order, section-level context, and cross-part evidence connections. Although retrieval-augmented generation (RAG) reduces the input context by retrieving relevant evidence, existing structured RAG methods still face three limitations: costly query-agnostic knowledge organization, insufficient use of original document structure, and no reuse of historical reasoning experience. To address these limitations, we propose DocTrace, a multi-agent RAG framework for long-document QA that supports query-triggered knowledge organization, document-structure-aware and experience-guided reasoning. DocTrace preserves document hierarchy with a lightweight document structural tree index, constructs agent-shared hypergraph-structured working memory on demand during reasoning, and stores successful reasoning plans in graph-structured experience memory for future reuse, enabling adaptive exploration across related long-document questions. Experiments on four long-document QA datasets show that DocTrace outperforms the strongest baseline, ComoRAG, with average relative gains of 16.91% in F1 and 15.50% in EM on open-form QA benchmarks, and by up to 20.67% and 23.78%, respectively, on NarrativeQA.

长文档问答多智能体超图记忆RAG

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。