arXiv:2607.14236cs.ROcs.AI2026-07被引 1

让视觉语言动作模型在接触操作中实时感知力反馈,提升抓取稳定性。

Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injection

论文配图:Never Too Late for Force: Accelerating VLA Post-Training with Reactive Force Injection
图 1 · 摘自论文原文
  • 通过因果力记忆与零初始化交叉注意力注入实时力信号,实现动作动态修正。
  • 在毛巾折叠等任务中训练速度更快,成功率比纯视觉方法高18%以上。
  • 适合需要精细接触控制的机器人抓取场景,如装配、折叠等复杂操作。

预训练的视觉-语言-动作(VLA)策略具备强大的语言驱动操作知识,但在进入接触状态时仍受限于视觉输入,因遮挡、深度模糊或微小力误差导致执行偏离离线演示分布。本文提出LIFT(Late Reactive Injection of Force for VLA Post-Training),一种基于力感知的后训练框架,在保留原有泛化操作能力的同时,为VLA策略增加接触反应能力。LIFT在原动作专家旁添加一个反应式动作专家,以预训练权重初始化,并通过因果力记忆和零初始化交叉注意力注入最近6维末端执行器力信号,使动作可在执行中实时刷新。为应对接触反馈带来的分布偏移问题,LIFT进一步结合在线DAgger循环,利用离线任务对齐数据与人工修正的在线轨迹联合训练。在毛巾折叠、书籍插入和汉诺塔环放置任务中,LIFT学习速度更快,性能更高;消融实验表明,反应式力记忆与在线纠错数据均对接触密集型操作的鲁棒性至关重要。代码与数据将公开。

原文摘要 · Abstract (English)

Pretrained vision-language-action (VLA) policies provide strong language-conditioned manipulation knowledge, but they remain largely vision-driven and can struggle once manipulation enters contact states where the scene is occluded, depth is ambiguous, or small force errors push execution off the offline demonstration distribution. We present LIFT (Late Reactive Injection of Force for VLA Post-Training), a force-aware post-training framework that adds contact reactivity to a pretrained VLA policy while preserving its general manipulation knowledge. LIFT grafts a reactive action expert beside the original action expert, initializes it from pretrained action weights, and injects recent 6D end-effector force through causal force memory and zero-initialized cross attention, enabling actions to be refreshed during execution. To address the policy-dependent distribution shift of contact feedback, LIFT further couples reactive force injection with an online DAgger loop that trains on a mixture of offline task-alignment data and human-corrected online rollouts. Across towel folding, book insertion, and Hanoi ring placement, LIFT learns faster and reaches higher performance than vision-only post-training, while ablations show that reactive force memory and online corrective data are both important for robust contact-rich manipulation. Our code and data will be publicly available.

力反馈机器人操作后训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。