arXiv:2604.09508cs.CVcs.AI2026-04中稿 · ACM Multimedia 202…

提出VISOR框架,解决视觉生成中长程推理的证据稀疏与搜索漂移问题。

VISOR: Agentic Visual Retrieval-Augmented Generation via Iterative Search and Over-horizon Reasoning

论文配图:VISOR: Agentic Visual Retrieval-Augmented Generation via Iterative Search and Over-horizon Reasoning
图 1 · 摘自论文原文
  • 构建结构化证据空间,支持跨页逐步推理
  • 引入视觉动作评估修正机制,提升细粒度检索质量
  • 动态轨迹滑窗+意图注入,防止长期推理中上下文过载

视觉检索增强生成(VRAG)使视觉语言模型能够检索并推理富含视觉信息的文档。为应对需要多步推理的复杂查询,代理式VRAG系统将推理与迭代检索交替进行。然而现有方法存在两大瓶颈:(1)视觉证据稀疏:关键证据分散在多页且孤立处理,阻碍跨页推理;细粒度图像内证据需精准视觉操作,误用会降低检索质量;(2)长视野搜索漂移:多页检索产生的视觉标记累积导致上下文稀释,引发认知过载,使代理偏离目标。为此,我们提出统一单代理框架VISOR(基于迭代搜索与超前推理的视觉检索增强生成)。VISOR包含结构化证据空间以实现渐进式跨页推理,并配备视觉动作评估与纠正机制管理视觉操作。此外,引入带滑动窗口的动态轨迹与意图注入策略,锚定证据空间并丢弃早期原始交互,防止视觉标记淹没上下文。采用基于组相对策略优化的强化学习(GRPO-based RL)训练管道,结合状态掩码与针对动态上下文重构的信用分配。在ViDoSeek、SlideVQA和MMLongBench上的大量实验表明,VISOR在保持合理可控计算成本的前提下,实现了最先进的长视野视觉推理性能。代码已开源于https://github.com/syc1336/VISOR。

原文摘要 · Abstract (English)

Visual Retrieval-Augmented Generation (VRAG) empowers Vision-Language Models to retrieve and reason over visually rich documents. To tackle complex queries requiring multi-step reasoning, agentic VRAG systems interleave reasoning with iterative retrieval. However, existing agentic VRAG faces two critical bottlenecks. (1) Visual Evidence Sparsity: key evidence is scattered across pages yet processed in isolation, hindering cross-page reasoning; moreover, fine-grained intra-image evidence often requires precise visual actions, whose misuse degrades retrieval quality; (2) Search Drift in Long Horizons: the accumulation of visual tokens across retrieved pages dilutes context and causes cognitive overload, leading agents to deviate from their search objective. To address these challenges, we propose VISOR (Visual Retrieval-Augmented Generation via Iterative Search and Over-horizon Reasoning), a unified single-agent framework. VISOR features a structured Evidence Space for progressive cross-page reasoning, coupled with a Visual Action Evaluation and Correction mechanism to manage visual actions. Additionally, we introduce a Dynamic Trajectory with Sliding Window and Intent Injection to mitigate search drift. They anchor the evidence space while discarding earlier raw interactions, preventing context from being overwhelmed by visual tokens. We train VISOR using a Group Relative Policy Optimization-based Reinforcement Learning (GRPO-based RL) pipeline with state masking and credit assignment tailored for dynamic context reconstruction. Extensive experiments on ViDoSeek, SlideVQA, and MMLongBench demonstrate that VISOR achieves state-of-the-art performance while maintaining reasonable and controllable computational costs for long-horizon visual reasoning tasks. The source code is available at https://github.com/syc1336/VISOR.

视觉推理检索增强生成模型长程任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。