DocSage通过结构化推理提升多文档多实体问答准确率
DocSage: An Information Structuring Agent for Multi-Doc Multi-Entity Question Answering
- 动态构建查询相关的最小关联模式,精准捕捉实体关系
- 在两个基准上准确率比现有方法提升超27%
- 适合需要跨文档复杂关系推理的学术与工业场景
多文档多实体问答要求模型在分散文档中追踪实体间的隐含逻辑。现有大语言模型和检索增强生成框架存在明显缺陷:传统RAG基于向量相似度的粗粒度检索常遗漏关键事实,图结构RAG难以高效整合碎片化关系网络,且均缺乏模式感知能力,导致跨文档证据链构建不足和实体关系推断不准。为此,我们提出端到端的智能体框架DocSage,融合动态模式发现、结构化信息抽取与带错误保障的模式感知关系推理。其包含三个核心模块:(1) 模式发现模块动态推导查询相关的最小可连接模式;(2) 抽取模块将非结构化文本转化为语义连贯的关系表,并通过误差感知校正机制降低抽取错误;(3) 推理模块在结构化表格上执行多跳关系推理,利用模式感知能力高效对齐跨文档实体并聚合证据。该智能体设计具备三大优势:通过SQL索引实现精确事实定位,通过关系表自然支持跨文档实体连接,通过结构化表示缓解大模型注意力发散。在两个MDMEQA基准上的评估表明,DocSage显著优于最先进长上下文LLM和RAG系统,准确率分别提升超过27%。
原文摘要 · Abstract (English)
Multi-document Multi-entity Question Answering inherently demands models to track implicit logic between multiple entities across scattered documents. However, existing Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) frameworks suffer from critical limitations: standard RAG's vector similarity-based coarse-grained retrieval often omits critical facts, graph-based RAG fails to efficiently integrate fragmented complex relationship networks, and both lack schema awareness, leading to inadequate cross-document evidence chain construction and inaccurate entity relationship deduction. To address these challenges, we propose DocSage, an end-to-end agentic framework that integrates dynamic schema discovery, structured information extraction, and schema-aware relational reasoning with error guarantees. DocSage operates through three core modules: (1) A schema discovery module dynamically infers query-specific minimal joinable schemas to capture essential entities and relationships; (2) An extraction module transforms unstructured text into semantically coherent relational tables, enhanced by error-aware correction mechanisms to reduce extraction errors; (3) A reasoning module performs multi-hop relational reasoning over structured tables, leveraging schema awareness to efficiently align cross-document entities and aggregate evidence. This agentic design offers three key advantages: precise fact localization via SQL-powered indexing, natural support for cross-document entity joins through relational tables, and mitigated LLM attention diffusion via structured representation. Evaluations on two MDMEQA benchmarks demonstrate that DocSage significantly outperforms state-of-the-art long-context LLMs and RAG systems, achieving more than 27% accuracy improvements respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。