让AI像人一样动态阅读长文档,边查边记边思考。
DocAtlas: Long-Document Understanding as Mutable-State Interaction

- 用可变状态的文档环境替代静态检索,动态管理信息获取与记忆。
- 在MMLongBench-Doc上达71.4%,超过人类专家参考值65.8%。
- 适合需要高效处理长文档的AI研究者与开发者使用。
长文档理解需在多页、布局、表格、图表间寻找并整合证据。现有检索增强系统通常在生成前从静态索引中选取证据,而近期代理系统虽支持多轮工具调用,但常依赖提示固定的专有模型。本文提出DocAtlas,将长文档理解视为可变状态的信息探索过程。通过构建外部可变文档环境(harness),决定每一步模型可搜索、阅读、存储、回顾和查看的信息。该环境提供搜索、阅读、笔记、回顾工具,维护层级树与笔记存储,并随证据记录动态更新。DocAtlas结合自提升检索、选择性证据访问与主动工作记忆,在固定上下文预算下实现统一框架。同一环境支持大视觉语言模型推理与端到端强化学习训练小型模型。使用GPT-5.4时,其在MMLongBench-Doc上达到71.4%,超过人类专家参考值65.8%。以Qwen3.5-4B VLM在该环境中通过端到端强化学习训练后,得分达63.7%,相较直接输入基线54.4%显著提升,证明可变文档环境设计能大幅改善紧凑型文档智能体性能。
原文摘要 · Abstract (English)
Long-document understanding requires models to find and combine evidence across many pages, layouts, tables, figures, and charts. Existing retrieval-augmented systems usually select evidence from a static index before generation, while recent agentic systems add multi-turn tool use but often rely on frozen proprietary backbones whose behavior is set by prompts. We present DocAtlas, a system that treats long-document understanding as a mutable-state information-seeking process. We instantiate DocAtlas as a mutable document harness: an external environment that determines what document information is searched, read, stored, reviewed, and shown to the model at each step. Given a document and question, the harness exposes search, reading, note-taking, and review tools, maintains a hierarchical tree and note store, and updates both as the agent records evidence. DocAtlas combines self-improving retrieval, selective evidence access, and active working memory under a fixed context budget. The same harness supports inference-time use with large VLMs and end-to-end reinforcement learning for compact VLM agents. With GPT-5.4, DocAtlas reaches 71.4\% on MMLongBench-Doc, exceeding the human-expert reference of 65.8\%. A Qwen3.5-4B VLM trained with end-to-end RL in the DocAtlas environment reaches 63.7\%, compared with a 54.4\% direct-input baseline, showing that mutable document-harness design can improve compact document agents by a large margin.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。