用视觉压缩降低大模型交互成本,同时解决视觉历史带来的决策偏差问题。
Reading is not Reasoning: Bridging the Agentic Policy Gap in Vision-Text Compression

- 通过跨模态自蒸馏,让视觉历史模型模仿文本历史的决策策略。
- 在SearchQA和ALFWorld上分别提升5.0%~15.6%,内存成本降低超60%。
- 适合需要高效推理与长程记忆的智能体系统开发者使用。
多步语言模型智能体持续处理不断增长的交互历史,导致显著的上下文开销。视觉-文本压缩通过将历史信息转为图像来降低开销,但由此引发的模态转换造成明显能力差距。通过控制实验评估历史恢复、状态决策和完整轨迹表现,我们发现该差距不能仅由OCR质量解释。视觉历史智能体在动作选择、查询构建、停止时机和证据使用上表现出系统性偏差,揭示了代理策略差距。本文提出CAPS——一种两阶段跨模态代理策略自蒸馏框架,利用同一模型更强的文本历史策略监督其视觉历史版本。离线轨迹自蒸馏将成功文本策略行为迁移到视觉输入,线上策略自蒸馏在强化学习过程中对视觉历史策略访问的状态提供密集监督。在SearchQA上,使用3B和7B参数量模型时,相比AgentOCR分别提升5.0%和3.4%;在全历史ALFWorld上,对应提升为15.6%和14.5%。在各类设置中,CAPS将平均上下文开销降低最多达63.3%,峰值开销降低最多达83.4%。结果表明,显式的跨模态策略自蒸馏可有效保留视觉-文本压缩下的智能体能力。代码将在后续公开。
原文摘要 · Abstract (English)
Multi-step language-model agents repeatedly process growing interaction histories, leading to substantial context costs. Vision--text compression reduces these costs by rendering history as images, but the resulting modality shift creates a marked capability gap. Through controlled evaluations of history recovery, matched-state decisions, and complete trajectories, we show that this gap cannot be explained by OCR quality alone. Visual-history agents exhibit systematic drift in action selection, query formulation, stopping, and evidence use, revealing an agentic policy gap. We introduce \textbf{CAPS}, a two-stage \textbf{C}ross-modal \textbf{A}gentic \textbf{P}olicy \textbf{S}elf-distillation framework that uses the same model's stronger text-history policy to supervise its visual-history counterpart. Offline trajectory self-distillation transfers successful text-policy behavior to visual-history inputs, while online policy self-distillation provides dense supervision on states visited by the visual-history policy during reinforcement learning. On SearchQA, CAPS improves over AgentOCR by 5.0\% and 3.4\% with 3B and 7B backbones, respectively. On full-history ALFWorld, the corresponding gains are 15.6\% and 14.5\%. Across settings, CAPS reduces average memory-context cost by up to 63.3\% and peak cost by up to 83.4\% relative to matched text-history policies. These results show that explicit cross-modal policy self-distillation can preserve agent capability under vision--text compression. Our code will be made publicly available in a future release.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。