arXiv:2605.17933cs.CV2026-05被引 4

让视觉语言模型自主构建空间记忆,无需外部指导即可提升复杂任务表现。

AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents

论文配图:AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents
图 1 · 摘自论文原文
  • 用空间热图、视觉样本和符号技能三层结构存储视觉化经验。
  • 通过轨迹统计自动生成危险与亲和地图,作为强化学习奖励。
  • 适合需要空间推理的机器人导航与操作任务,无需依赖大模型监督。

视觉-语言模型(VLM)代理在长时程任务中依赖记忆增强的强化学习来复用经验,但现有框架通常将记忆以文本形式存储,并依赖专有的教师模型进行总结或优化。这种设计与空间决策不匹配:几何先验被压缩为损失严重的语言信息,稀疏交互常由延迟的文本反馈监督,而非密集的视觉信号。我们提出 extbf{AtlasVA},一种无需教师模型的视觉技能记忆框架,将记忆组织为三重互补层:空间热图、视觉样本和符号文本技能。AtlasVA直接从轨迹统计和轻量网格启发式生成危险与亲和地图,并将其作为潜在函数塑造奖励用于强化学习。该方法统一了感知、记忆与优化,无需外部大模型监督。在 extsc{Sokoban}、 extsc{FrozenLake}、3D具身导航和3D机器人操作基准上的实验表明,AtlasVA持续优于以文本为中心的记忆基线及竞争性VLM代理,尤其在空间密集型任务中表现突出。

原文摘要 · Abstract (English)

Vision-language model (VLM) agents increasingly rely on memory-augmented reinforcement learning to reuse experience across long-horizon tasks, yet most existing frameworks store memory as text and depend on proprietary teacher models to summarize or refine it. This design is poorly matched to spatial decision making: geometric priors are compressed into lossy language, and sparse interaction is often supervised through delayed textual feedback rather than dense visually grounded signals. We argue that reusable experience for VLM agents should remain visually grounded. Based on this insight, we propose \textbf{AtlasVA}, a teacher-free visual skill memory framework that organizes memory into three complementary layers: spatial heatmaps, visual exemplars, and symbolic text skills. AtlasVA further evolves danger and affinity atlases directly from trajectory statistics and lightweight grid heuristics, and reuses these self-evolving atlases as potential-based shaping rewards for reinforcement learning. This unifies perception, memory, and optimization without external LLM supervision. Experiments on \textsc{Sokoban}, \textsc{FrozenLake}, 3D embodied navigation, and 3D robotic manipulation benchmarks show that AtlasVA consistently outperforms text-centric memory baselines and competitive VLM agents, with especially strong gains on spatially intensive tasks. Homepage: https://wangpan-ustc.github.io/AtlasvaWeb

视觉记忆强化学习机器人操作自进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。