arXiv:2606.17463cs.CVcs.RO2026-06被引 1

让机器人在重复操作中跨任务传递记忆,提升复杂动作成功率。

WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation

论文配图:WeaveLA: Event Driven Cross-Subtask Latent Memory Weaving for Repetitive Robot Manipulation
图 1 · 摘自论文原文
  • 以子任务完成事件触发记忆传递,将上一阶段信息压缩为隐向量注入下一阶段。
  • 在最难的重复任务上成功率从0%提升至47.8%,单次执行任务无变化。
  • 轻量级设计不改动原有模型,适合需要跨阶段信息协同的机器人任务。

视觉-语言-动作(VLA)策略在单步操作中表现优异,但在多阶段依赖任务中仍显脆弱。核心问题在于:短窗口VLA缺乏跨子任务的信息传递通道。现有记忆增强方法或每帧写入、或仅在演示阶段检索、或在子目标事件时触发但未显式传递给动作专家。本文识别子目标完成事件为跨子任务记忆交接的自然时间单元,提出WeaveLA——一种基于冻结VLA主干的交叉子任务记忆接口。该方法通过查询驱动的注意力池化,将每个完成阶段压缩为隐向量,并直接路由至下一子任务的动作生成路径。这种事件触发、面向动作端的设计,在保留原模型短窗口接口的同时,新增轻量级跨子任务通道。在RoboMME上使用π₀.₅主干的分层评估显示,该方法在最困难的重复性任务(SwingXtimes, N=3)上成功率从0%提升至47.8%,而单次执行任务性能不变。每任务配对分析证实增益仅出现在需要跨子任务信息的任务中。

原文摘要 · Abstract (English)

Vision-Language-Action (VLA) policies have achieved remarkable single-step manipulation, yet they remain brittle precisely where each stage depends on what was just completed. The core issue is structural: short-window VLAs lack an explicit channel for rouxting information across sub-task boundaries, and existing memory-augmented variants either write at every frame, retrieve from demonstration-time stages, or fire at sub-goal events without performing an explicit sub-task-to-sub-task hand-off into the action expert. We identify the sub-goal completion event as the natural temporal unit for cross-subtask memory hand-off, and present WeaveLA (Weave Latent memory for Vision-Language-Action policies), a cross-subtask memory interface that, on top of a frozen VLA backbone, compresses each completed segment into latent tokens via query-driven attention pooling and routes them directly into the action-generation path of the next sub-task. This event-triggered, action-side design preserves the base policy's short-window interface while adding a lightweight cross-subtask channel. Through stratified evaluation on RoboMME with a $π_{0.5}$ backbone, WeaveLA's gains land exactly where the channel is needed: on the hardest repetition slice (SwingXtimes, $N{=}3$), success rises from $0\%$ to $47.8\%$, while single-execution episodes remain unchanged. Per-episode paired analysis confirms the gains are confined to tasks whose causal structure requires cross-subtask information.

机器人操作记忆机制多阶段任务

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。