arXiv:2503.10743cs.ROcs.LG2025-03CVPR被引 33

提出新方法让双臂机器人更安全、更自然地完成复杂操作。

Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation

  • 用动态时空图建模双臂结构,实时捕捉机械约束。
  • 引入可微分逆运动学,使动作预测符合关节限制。
  • 在仿真和真实机器人上均实现无碰撞、高精度操作。

尽管模仿学习在机器人操作中取得显著进展,但其在双臂任务中的应用仍极具挑战。现有方法通常预测远距离的下一最佳末端执行器位姿(NBP),再通过逆运动学计算关节角度,但存在两大问题:(1) 忽视物理机器人结构,易引发自碰撞或干涉;(2) 忽略运动学约束,导致预测位姿超出实际关节极限。本文提出增强运动学的时空图扩散策略(KStar Diffuser)。具体而言,(1) 构建随时间动态更新的时空图,以反映双臂连续运动下的物理结构,作为去噪动作的结构条件;(2) 引入可微分运动学模块,为优化提供参考,使策略能生成更可靠、符合运动学约束的下一末端执行器位姿。实验结果表明,该方法在仿真与真实场景中均有效利用结构信息,生成符合运动学限制的动作,显著提升操作安全性与成功率。

原文摘要 · Abstract (English)

Despite the significant success of imitation learning in robotic manipulation, its application to bimanual tasks remains highly challenging. Existing approaches mainly learn a policy to predict a distant next-best end-effector pose (NBP) and then compute the corresponding joint rotation angles for motion using inverse kinematics. However, they suffer from two important issues: (1) rarely considering the physical robotic structure, which may cause self-collisions or interferences, and (2) overlooking the kinematics constraint, which may result in the predicted poses not conforming to the actual limitations of the robot joints. In this paper, we propose Kinematics enhanced Spatial-TemporAl gRaph Diffuser (KStar Diffuser). Specifically, (1) to incorporate the physical robot structure information into action prediction, KStar Diffuser maintains a dynamic spatial-temporal graph according to the physical bimanual joint motions at continuous timesteps. This dynamic graph serves as the robot-structure condition for denoising the actions; (2) to make the NBP learning objective consistent with kinematics, we introduce the differentiable kinematics to provide the reference for optimizing KStar Diffuser. This module regularizes the policy to predict more reliable and kinematics-aware next end-effector poses. Experimental results show that our method effectively leverages the physical structural information and generates kinematics-aware actions in both simulation and real-world

双臂机器人运动规划扩散模型逆运动学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。