让机器人记住自己做过的事,提升复杂操作的成功率。
Remember what you did?: Learning Behavioral Memories for Partially Observable Object Manipulation

- 用自身动作历史构建压缩记忆,无需额外监督
- 在四个真实机器人任务中显著超越现有方法
- 适合需要长期记忆的物理交互任务研究
长时程、接触丰富的操作任务本质上是部分可观测的。单次视觉观测通常无法捕捉机器人完整的动作上下文,包括先前尝试、交互过程或进展状态。因此,标准的视觉-运动策略或视觉-语言-动作模型在这些任务中容易失效,因其缺乏记忆能力。为此,我们提出基于自监督动作历史信号的压缩动作记忆策略(CAMP),通过训练一个记忆模块来维护过去动作的紧凑表示,使其编码出机器人所有过往交互的潜在行为记忆,从而更好地理清未来动作的上下文。该方法能隐式追踪通用任务进展,并从失败中学习,无需额外监督或外部干预。我们在四个真实机器人场景及两个新提出的仿真基准(Memory-T-Bench 和 Memory-Manip-Bench)上评估了 CAMP。结果表明,相较于当前最优基线,其性能有显著提升,据我们所知,CAMP 是首个仅通过学习记忆就在接触丰富、部分可观测操作任务中取得实质性成功的策略。
原文摘要 · Abstract (English)
Long horizon, contact-rich manipulation is inherently partially observable. This is as a single visual observation rarely captures a robot's full action context, including prior attempts, interactions, or progress. Consequently, standard visuomotor policies or vision-language-action models are prone to struggle in such tasks due to a lack of memory. To address this, we introduce Compressed Action Memory Policy (CAMP) based on the insight that a robot's own action history serves as a highly informative, self-supervised signal, enabling the policy to learn a robust, compact history representation. In our approach, we train a memory module to maintain a compressed representation of past actions, forcing it to encode a latent behavioral memory of all the robot's past interactions that can then be used to better contextualize future actions. This allows our approach to implicitly track generalized task progress and learn from failed attempts without any additional supervision, or external oversight. We evaluate CAMP across four real-robot setups and two novel simulation benchmarks: Memory-T-Bench and Memory-Manip-Bench. By demonstrating substantial gains over state-of-the-art baselines, CAMP is, to our knowledge, the first policy to demonstrate substantial success on contact-rich partially observable manipulation tasks purely through learned memory.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。