让双臂机器人学习对称动作,提升操作一致性与鲁棒性。
EquiBim: Learning Symmetry-Equivariant Policy for Bimanual Manipulation
- 通过群作用建模对称性,强制策略在对称输入下输出对称动作。
- 在仿真和真实机器人上均显著提升双臂操作的性能与鲁棒性。
- 适用于点云、图像等多种观测,兼容不同动作表示方式。
机器人模仿学习在复杂操作行为学习中取得显著进展。然而,许多现有方法未显式考虑机器人系统的物理对称性,导致在对称观测下产生非对称或不一致的行为。这一问题在双臂操作中尤为突出,因为机器人结构和任务本身具有固有对称性。本文提出 EquiBim,一种针对双臂操作的对称等变策略学习框架,在训练中强制观测与动作之间的双边等变性。该方法将物理对称性建模为观测与动作空间上的群作用,并对对称变换下的策略预测施加等变约束。框架具备模型无关性,可无缝集成于多种模仿学习流程,支持点云、图像等多模态观测及末端空间与关节空间的动作表示。我们在具有对称运动学的 RoboTwin 双臂平台上进行评估,涵盖多种观测与动作配置的仿真实验,并在真实双臂系统上验证。结果表明,该方法在模拟与物理实验中均能持续提升性能与分布外鲁棒性。这表明显式引入物理对称性是一种简单而有效的双臂机器人学习归纳偏置。
原文摘要 · Abstract (English)
Robotic imitation learning has achieved impressive success in learning complex manipulation behaviors from demonstrations. However, many existing robot learning methods do not explicitly account for the physical symmetries of robotic systems, often resulting in asymmetric or inconsistent behaviors under symmetric observations. This limitation is particularly pronounced in dual-arm manipulation, where bilateral symmetry is inherent to both the robot morphology and the structure of many tasks. In this paper, we introduce EquiBim, a symmetry-equivariant policy learning framework for bimanual manipulation that enforces bilateral equivariance between observations and actions during training. Our approach formulates physical symmetry as a group action on both observation and action spaces, and imposes an equivariance constraint on policy predictions under symmetric transformations. The framework is model-agnostic and can be seamlessly integrated into a wide range of imitation learning pipelines with diverse observation modalities and action representations, including point cloud-based and image-based policies, as well as both end-effector-space and joint-space parameterizations. We evaluate EquiBim on RoboTwin, a dual-arm robotic platform with symmetric kinematics, and evaluate it across diverse observation and action configurations in simulation. We further validate the approach on a real-world dual-arm system. Across both simulation and physical experiments, our method consistently improves performance and robustness under distribution shifts. These results suggest that explicitly enforcing physical symmetry provides a simple yet effective inductive bias for bimanual robot learning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。