arXiv:2605.15198cs.CVcs.AI2026-05被引 1

一个词同时实现智能体操作与隐式视觉推理,高效又可解释。

ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both

论文配图:ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both
图 1 · 摘自论文原文
  • 用单一离散'功能词'兼作操作指令与隐状态,无需视觉监督。
  • 在多个挑战性基准上表现更优,且训练稳定、可扩展。
  • 适合追求高效视觉推理与模型可解释性的研究者使用。

视觉推理常涉及中间视觉状态的交互,是当前重要方向。直接通过统一模型生成图像虽可行,但计算开销大且架构复杂。现有方法分为两类:通过代码或工具调用的智能体推理,存在外部执行上下文切换延迟;以及基于可学习隐嵌入的隐式推理,泛化能力差且难以用自回归方式并行训练。为融合两者优势并克服缺陷,本文提出ATLAS框架:一个称为‘功能词’的离散标记,既能作为智能体操作,又能作为隐式视觉推理单元。每个功能词关联内部视觉操作,不需视觉标注,仍为标准分词器词汇,可通过下一步词预测生成。该设计避免冗余中间图像生成,兼容标准SFT与强化学习训练,无需架构修改。针对强化学习中功能词稀疏问题,引入隐式锚定GRPO(LA-GRPO),通过静态加权辅助目标稳定训练,提供更强梯度更新。大量实验与分析表明,ATLAS在多个挑战性基准上表现优异,且具备良好可解释性。我们希望其能为未来视觉推理研究提供新范式。

原文摘要 · Abstract (English)

Visual reasoning, often interleaved with intermediate visual states, has emerged as a promising direction in the field. A straightforward approach is to directly generate images via unified models during reasoning, but this is computationally expensive and architecturally non-trivial. Recent alternatives include agentic reasoning through code or tool calls, and latent reasoning with learnable hidden embeddings. However, agentic methods incur context-switching latency from external execution, while latent methods lack task generalization and are difficult to train with autoregressive parallelization. To combine their strengths while mitigating their limitations, we propose ATLAS, a framework in which a single discrete 'word', termed as a functional token, serves both as an agentic operation and a latent visual reasoning unit. Each functional token is associated with an internalized visual operation, yet requires no visual supervision and remains a standard token in the tokenizer vocabulary, which can be generated via next-token prediction. This design avoids verbose intermediate visual content generation, while preserving compatibility with the vanilla scalable SFT and RL training, without architectural or methodological modifications. To further address the sparsity of functional tokens during RL, we introduce Latent-Anchored GRPO (LA-GRPO), which stabilizes the training by anchoring functional tokens with a statically weighted auxiliary objective, providing stronger gradient updates. Extensive experiments and analyses demonstrate that ATLAS achieves superior performance on challenging benchmarks while maintaining clear interpretability. We hope ATLAS offers a new paradigm inspiring future visual reasoning research.

视觉推理功能词强化学习可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。