arXiv:2510.21850cs.CVcs.CL2025-10Conference of the …

让AI像人一样有选择地阅读长文档,提升导航效率

SCoPE VLM: Selective Context Processing for Efficient Document Navigation in Vision-Language Models

  • 用滚动链机制只关注文档相关段落,减少无效计算
  • 内存使用大幅降低,支持本地部署的智能导航
  • 专为网页和GUI控制设计,适合多页文档问答任务

理解长篇视觉信息仍是视觉语言模型的核心挑战,尤其在代理类任务如GUI控制和网页导航中。尽管网页和GUI环境本质上是结构化文档,现有VLM在训练目标上通常忽视面向决策的文档理解。当前方法主要通过扩展视觉嵌入来处理长而高分辨率的输入,但这类方法内存开销大,不适用于本地部署。为此,我们提出SCoPE VLM,一种专注于文档导航的专家模型,采用创新的滚动链(Chain of Scroll)机制,实现对文档的有选择性、递归式浏览,仅聚焦相关片段。我们构建了专用的数据生成流程,生成具有信息量的滚动轨迹,并引入基于情景组相对策略优化(Episodic Group Relative Policy Optimization)的强化学习方法,弥合训练与推理间的差距。该方法显著降低内存占用,有效建模类人阅读行为。据我们所知,SCoPE VLM是首个显式建模多页文档问答中代理式阅读模式的框架,推动了多模态智能体的能力边界。

原文摘要 · Abstract (English)

Understanding long-context visual information remains a fundamental challenge for vision-language models, particularly in agentic tasks such as GUI control and web navigation. While web pages and GUI environments are inherently structured documents, current VLMs typically neglect decision-oriented document understanding in their training objectives. Existing approaches primarily extend visual embeddings to process long, high-resolution inputs, but these methods are memory-intensive and impractical for locally deployable solutions. To address these issues, we propose SCoPE VLM, a document navigation expert that leverages a novel Chain of Scroll mechanism to selectively and recursively navigate documents, focusing exclusively on relevant segments. We introduce a dedicated data generation pipeline to construct informative Chain of Scroll trajectories and Episodic Group Relative Policy Optimization, a tailored reinforcement learning method to bridge the gap between training and inference. Our method substantially reduces memory usage and effectively models human-like reading behaviors. To the best of our knowledge, SCoPE VLM is the first framework to explicitly model agentic reading patterns in multi-page document question answering, advancing the capabilities of multimodal agents.

文档理解视觉语言模型智能导航强化学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。