arXiv:2512.17568cs.RO2025-12被引 2

让机械臂用3D点云统一表示状态和动作,提升全臂操作的泛化能力。

Kinematics-Aware Diffusion Policy with Consistent 3D Observation and Action Space for Whole-Arm Robotic Manipulation

  • 用3D点集统一表示机械臂状态与动作,与观测空间对齐
  • 在仿真和真实场景中成功率更高,空间泛化能力更强
  • 适合需要避障或全身交互的复杂机械臂任务

具备完整臂体运动学感知的全臂控制对避免身体碰撞或实现体物交互等操作至关重要,仅考虑末端执行器位姿不足以满足需求。传统方法在关节空间学习动作,但关节空间与实际任务空间(即3D空间)不一致,增加了策略学习难度。本工作提出一种运动学感知的模仿学习框架,使任务空间、观测空间与动作空间均统一在相同3D空间中。具体地,使用机械臂体表面的一组3D点表示状态与动作,自然对齐于3D点云观测。该空间一致性设计提升了策略的样本效率与空间泛化性,支持全臂控制。基于扩散策略,进一步将运动学先验融入扩散过程,确保输出动作的运动学可行性。最终通过基于优化的全臂逆运动学求解器生成关节角指令并执行。仿真与真实实验结果表明,该方法在体感知操作策略学习中具有更高的成功率和更强的空间泛化能力。

原文摘要 · Abstract (English)

Whole-body control of robotic manipulators with awareness of full-arm kinematics is crucial for many manipulation scenarios involving body collision avoidance or body-object interactions, which makes it insufficient to consider only the end-effector poses in policy learning. The typical approach for whole-arm manipulation is to learn actions in the robot's joint space. However, the unalignment between the joint space and actual task space (i.e., 3D space) increases the complexity of policy learning, as generalization in task space requires the policy to intrinsically understand the non-linear arm kinematics, which is difficult to learn from limited demonstrations. To address this issue, this letter proposes a kinematics-aware imitation learning framework with consistent task, observation, and action spaces, all represented in the same 3D space. Specifically, we represent both robot states and actions using a set of 3D points on the arm body, naturally aligned with the 3D point cloud observations. This spatially consistent representation improves the policy's sample efficiency and spatial generalizability while enabling full-body control. Built upon the diffusion policy, we further incorporate kinematics priors into the diffusion processes to guarantee the kinematic feasibility of output actions. The joint angle commands are finally calculated through an optimization-based whole-body inverse kinematics solver for execution. Simulation and real-world experimental results demonstrate higher success rates and stronger spatial generalizability of our approach compared to existing methods in body-aware manipulation policy learning.

机器人控制扩散模型运动学模仿学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。