arXiv:2606.02775cs.AIcs.AR2026-06被引 2

为机器人设计常量显存的智能记忆,只在关键时才写入。

AURA: Action-Gated Memory for Robot Policies at Constant VRAM

  • 用动作惊喜信号控制记忆写入,仅在观测影响下一步动作时才更新。
  • 10万步时显存仅4.2KB,比KV缓存少9倍以上写入次数。
  • 适用于边缘设备上的长期任务,适合低功耗机器人部署。

KV缓存适合数据中心但不适合机器人。数据中心批量处理短请求并重置,可摊销注意力缓存开销;而具身智能体在带宽受限的边缘硬件上运行单一长期不重置的推理序列,高带宽内存和闪存稀缺,且闪存写入次数有限,内存写入可能成为瓶颈。AURA-Mem(动作-效用递归自适应记忆)针对此场景设计:在冻结的视觉-语言-动作主干外,增加固定大小的循环记忆与学习门控机制,仅当当前观测会改变下一步动作时才写入——记忆懂得何时保持沉默。该门控直接基于闭环动作误差信号训练,而非重构损失。其推理状态始终为4,224字节,无论时长;而标准KV缓存到100,000步时增长至6,061倍。在合成基准测试中,AURA-Mem在准确率上持平最优O(1)基线,写入减少5.19–6.13倍,简单配置下达9.19倍。预算匹配的随机与周期策略无法复现此收益,凸显动作惊喜信号的核心作用。在训练好的闭环OpenVLA-OFT 7B模型于LIBERO-Long数据集(每机械臂60个任务)上的实验显示,门控未损害成功率:成功率达0.233,优于始终写入的KV缓存臂(0.217),同时写入减少7.0倍,显存恒定。我们还演示了近似信息状态值损失界的方法论,但在该规模下该界无实际约束力。

原文摘要 · Abstract (English)

The KV-cache is the right memory for datacenters but the wrong memory for robots. Datacenter inference batches many short requests and resets them, amortizing an attention cache across a crowd. Embodied agents instead run one long, non-resetting episode on bandwidth-limited edge hardware, where high-bandwidth memory and flash are scarce, flash has finite write endurance, and memory writes rather than compute can become the binding constraint. AURA-Mem (Action-Utility Recurrent Adaptive Memory) targets this regime. It wraps a frozen vision-language-action backbone with a constant-size recurrent memory and a learned gate that writes only when the current observation would change the next action: memory that knows when to stay silent. Unlike reconstruction-based memory, the gate is trained directly against a closed-loop action-error signal. Its inference state is fixed at 4,224 bytes regardless of horizon, while a KV-cache grows to 6,061 times larger at 100,000 steps. On a controlled synthetic benchmark, AURA-Mem matches the best O(1) baseline in accuracy while using 5.19-6.13 times fewer writes, and up to 9.19 times fewer writes on easier configurations. Budget-matched random and periodic schedules do not recover this gain, isolating the benefit to the action-surprise signal. On a trained closed-loop OpenVLA-OFT 7B panel on LIBERO-Long (n=60 episodes per arm), the gate does not hurt success: AURA-Mem matches the ungated base policy (0.233) and slightly exceeds an always-write KV arm (0.217), while using 7.0 times fewer writes and constant memory. We also instantiate an approximate-information-state value-loss bound as a methodology demonstration; at this scale, the bound is vacuous rather than a guarantee.

机器人记忆机制常量显存边缘计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。