让机器人在操作中实时应对突发情况,靠人类指点快速重规划路径。
Referring-Aware Visuomotor Policy Learning for Closed-Loop Manipulation
- 用稀疏指代点驱动闭环重规划,结合全局与局部扩散模型生成动作
- 在模拟和真实场景中成功率显著提升,无需额外数据或微调
- 适合需要动态应变的复杂机械臂任务,如家庭服务或工业装配
本文解决机器人操作中视觉-运动策略学习的核心挑战:如何在分布外执行误差或动态轨迹重规划时保持鲁棒性,且仅依赖原始专家示范进行训练。提出一种闭环框架ReV(Referring-Aware Visuomotor Policy),通过即时引入人类或高层规划器提供的稀疏指代点,适应意外情况。ReV利用耦合的扩散头,在保持标准任务模式的同时,通过轨迹引导策略无缝融合稀疏指代点。接收指代点后,全局扩散头首先生成全局一致但时间稀疏的动作锚点,并确定该指代点在序列中的精确时间位置;随后,局部扩散头根据当前时间位置自适应插值相邻锚点以完成特定任务。该闭环过程在每一步执行中重复,实现对场景动态变化的实时轨迹重规划。实践中,ReV仅通过对专家示范施加针对性扰动进行训练,无需额外数据或微调方案,在复杂模拟与真实任务中均取得更高成功率。
原文摘要 · Abstract (English)
This paper addresses a fundamental problem of visuomotor policy learning for robotic manipulation: how to enhance robustness in out-of-distribution execution errors or dynamically re-routing trajectories, where the model relies solely on the original expert demonstrations for training. We introduce the Referring-Aware Visuomotor Policy (ReV), a closed-loop framework that can adapt to unforeseen circumstances by instantly incorporating sparse referring points provided by a human or a high-level reasoning planner. Specifically, ReV leverages the coupled diffusion heads to preserve standard task execution patterns while seamlessly integrating sparse referring via a trajectory-steering strategy. Upon receiving a specific referring point, the global diffusion head firstly generates a sequence of globally consistent yet temporally sparse action anchors, while identifies the precise temporal position for the referring point within this sequence. Subsequently, the local diffusion head adaptively interpolates adjacent anchors based on the current temporal position for specific tasks. This closed-loop process repeats at every execution step, enabling real-time trajectory replanning in response to dynamic changes in the scene. In practice, rather than relying on elaborate annotations, ReV is trained only by applying targeted perturbations to expert demonstrations. Without any additional data or fine-tuning scheme, ReV achieve higher success rates across challenging simulated and real-world tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。