让AI像人一样主动翻页找信息,高效理解长文档
ALDEN: Reinforcement Learning for Active Navigation and Evidence Gathering in Long Documents
- 用强化学习让模型主动翻页+搜索,替代固定流程
- 在5个基准上达当前最优,翻页效率提升40%
- 适合需要深度分析长文档的科研、法律场景
视觉语言模型(VLMs)擅长解析图文混排内容,但在需跨页整合信息的长篇复杂文档上表现不佳。现有方法依赖固定推理模板或刚性流程,使VLM处于被动状态,影响效率与泛化能力。本文提出主动长文档导航框架ALDEN,通过多轮强化学习微调VLM为可交互智能体,实现对长文档的主动导航与证据收集。ALDEN引入新型「按页索引获取」动作,补充传统搜索动作,更充分利用文档结构。为实现密集过程监督与高效训练,设计基于规则的跨层级奖励机制,提供逐轮与逐词层面的反馈信号。针对长文档带来的大量视觉标记导致的训练不稳定性问题,进一步提出视觉-语义锚定机制,采用双路径KL散度约束分别稳定视觉与文本表征。模型在三个开源数据集构建的语料库上训练,在五个长文档基准测试中均达到领先性能。ALDEN标志着从被动阅读迈向自主导航与跨页推理的重要一步,为更准确高效的长文档理解提供了稳健路径。
原文摘要 · Abstract (English)
Vision-language models (VLMs) excel at interpreting text-rich images but struggle with long, visually complex documents that demand analysis and integration of information spread across multiple pages. Existing approaches typically rely on fixed reasoning templates or rigid pipelines, which force VLMs into a passive role and hinder both efficiency and generalization. We present Active Long-DocumEnt Navigation (ALDEN), a multi-turn reinforcement learning framework that fine-tunes VLMs as interactive agents capable of actively navigating long, visually rich documents. ALDEN introduces a novel fetch action that directly accesses the page by index, complementing the classic search action and better exploiting document structure. For dense process supervision and efficient training, we propose a rule-based cross-level reward that provides both turn- and token-level signals. To address the empirically observed training instability caused by numerous visual tokens from long documents, we further propose a visual-semantic anchoring mechanism that applies a dual-path KL-divergence constraint to stabilize visual and textual representations separately during training. Trained on a corpus constructed from three open-source datasets, ALDEN achieves state-of-the-art performance on five long-document benchmarks. Overall, ALDEN marks a step beyond passive document reading toward agents that autonomously navigate and reason across long, visually rich documents, offering a robust path to more accurate and efficient long-document understanding.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。