arXiv:2608.03292cs.AI2026-08

让大模型回答长文档问题时能追踪证据来源,提升可解释性。

DocTrace: Towards Traceable Long Document VQA via Hierarchical Evidence Graph Reasoning

论文配图:DocTrace: Towards Traceable Long Document VQA via Hierarchical Evidence Graph Reasoning
图 1 · 摘自论文原文
  • 构建分层证据图,逐步定位、解析并推理文档信息。
  • 在三个基准上分别比Qwen3-VL-8B-Instruct高14.4、11.3、11.7分。
  • 生成带节点溯源的证据图,适合需要透明推理的场景。

长文档视觉问答(LongDocVQA)要求多模态大模型在跨页的异构文档元素中定位、整合并推理信息。现有方法如端到端大模型、检索增强生成(RAG)和文档智能体,缺乏对推理过程中证据逐步构成的显式表示与验证机制,限制了答案准确性和可追溯性。本文将LongDocVQA视为显式证据图推理问题,提出分层框架DocTrace:通过渐进式证据定位、结构化文档解析与证据图推理,实现证据来源的显式追踪。为有效学习这些能力,设计两阶段训练策略:先联合监督微调(SFT)初始化定位与图推理能力,再通过任务特异性组相对策略优化(GRPO)及专属奖励进一步优化。在MMLongBench-Doc、LongDocURL和SlideVQA上的实验表明,DocTrace持续优于开源与闭源基线模型。相比Qwen3-VL-8B-Instruct,其在三数据集上分别提升14.4、11.3、11.7分。除性能优越外,该方法还能生成带节点级溯源的可追踪证据图,支持透明且可验证的长文档理解。

原文摘要 · Abstract (English)

Long Document Visual Question Answering (LongDocVQA) requires Multimodal Large Language Models (MLLMs) to locate, integrate, and reason over heterogeneous document elements distributed across multiple pages. Existing approaches, including end-to-end MLLMs, retrieval-augmented generation (RAG) pipelines, and document agents, often lack explicit mechanisms to represent and verify how grounded evidence is progressively composed during reasoning, limiting both answer accuracy and traceability. In this paper, we cast LongDocVQA as an explicit evidence graph reasoning problem rather than implicit answer prediction. To this end, we propose DocTrace, a hierarchical framework that progressively performs evidence localization, structured document parsing, and evidence graph reasoning to enable explicit evidence provenance. To effectively learn these capabilities, we develop a two-stage training framework: joint Supervised Fine-Tuning (SFT) first initializes evidence localization and graph reasoning abilities, followed by task-specific Group Relative Policy Optimization (GRPO) with dedicated rewards to further optimize these capabilities. Extensive experiments on MMLongBench-Doc, LongDocURL, and SlideVQA demonstrate that DocTrace consistently outperforms both existing open-source baselines and proprietary MLLMs. Compared with the Qwen3-VL-8B-Instruct backbone, DocTrace achieves absolute improvements of 14.4, 11.3, and 11.7 points on the three benchmarks, respectively. Beyond competitive performance, DocTrace constructs traceable evidence graphs with explicit node-level provenance, enabling transparent and verifiable reasoning for long document understanding.

长文档问答证据图可追溯性多模态推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。