arXiv:2605.15352cs.RO2026-05

用扩散模型让机器人双臂协同移动开门并穿过,一次学成。

Diffusion Policy for Coordinated Control of a Nonholonomic Mobile Base and Dual Arms in Door Opening and Passing

论文配图:Diffusion Policy for Coordinated Control of a Nonholonomic Mobile Base and Dual Arms in Door Opening and Passing
图 1 · 摘自论文原文
  • 基于扩散模型的端到端策略,统一控制移动底盘与双臂动作。
  • 在阻尼拉门任务中成功率高,且抗外部干扰能力强。
  • 适合需要复杂协调的机器人操作场景,如居家服务或救援。

开启沉重且带自闭功能的拉门,尤其需拉动手柄的场景,一直是机器人领域的长期挑战。人类会自然地使用双臂灵巧操作:旋转把手、扩大缝隙、持门通行、适时换手,并保持通过时的空间间隙。要实现类似行为,机器人必须完成跨越多个阶段、涉及门不同部位的长序列动作。传统方法依赖手动定义状态机,按阶段切换(如转完把手再拉,缝隙足够大后才通过),虽直观但鲁棒性差,手工轨迹难以泛化至真实世界多样条件,需大量工程投入。近期模仿学习提供可扩展替代方案,但现有视觉动作模型尚未实现非完整移动基座与双臂在完整开门-通行任务中的同步协调。本文提出一种基于扩散的视觉运动控制策略,成功训练出单一端到端策略,可执行需精密操控与移动协调的长时序任务。结果表明,该策略不仅在开启阻尼拉门任务中取得高成功率,还展现出强抗干扰能力,这是传统方法难以实现的。

原文摘要 · Abstract (English)

Opening heavy, self closing doors, especially those that require pulling remains a long standing challenge in robotics. Humans naturally employ both arms in a dexterous manner, rotating the handle, widening the gap, holding the door, switching arms when needed, and moving through while maintaining clearance. To replicate such behaviors, a robot must perform a long sequence of motions spanning multiple stages and interactions with different parts of the door. Traditional approaches rely on state machines that transition between manually defined stages (e.g., pulling after the knob is rotated, passing after the gap is sufficiently wide). While intuitive, these methods lack robustness, as hand crafted trajectories fail to generalize to the diversity of real world conditions without extensive engineering effort. Recent advances in imitation learning offer a scalable alternative, yet no existing visual action model has demonstrated simultaneous coordination of a nonholonomic base and dual arms for the complete door opening and passing task. In this paper, we tackle this complex, highly constrained problem using a diffusion based visuomotor control policy. Our results demonstrate that a single end to end policy can be learned to execute long horizon tasks requiring tight coordination between manipulation and locomotion. The resulting policy not only achieves a high success rate in opening and traversing damped pull doors but also demonstrates strong robustness to external disturbances capabilities that are difficult to realize with traditional methods.

机器人控制扩散模型多模态协调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。