通过三元空间关系建模,提升双臂操作的稳定性与协调性。
RoTri-Diff: A Spatial Robot-Object Triadic Interaction-Guided Diffusion Model for Bimanual Manipulation
- 构建机器人-物体三元交互表征,捕捉双臂与物体的6D相对位姿。
- 在扩散模型中融合三元约束,生成更稳定协调的双臂轨迹。
- 在11个仿真任务和4个真实场景中表现优异,适合复杂双臂操作。
双臂操作是机器人的一项基础技能,需要双臂之间持续精确的协同。尽管模仿学习是获取该能力的主要范式,但现有方法(无论是以机器人为中心还是以物体为中心)常忽略双臂与被操作物体之间的动态几何关系,导致双臂碰撞、抓取不稳及复杂任务性能下降。为此,本文在双臂系统中显式建模机器人-物体三元交互(RoTri)表示,通过编码双臂与物体间的相对6D位姿,捕捉其空间三元关系并建立连续的三角几何约束。在此基础上,提出RoTri-Diff——一种基于扩散的模仿学习框架,通过分层扩散过程联合整合RoTri约束、机器人关键姿态与物体运动,实现稳定协调轨迹的生成,并在多种双臂操作模式中实现鲁棒执行。大量实验表明,本方法在11个代表性RLBench2任务上较最先进基线提升10.2%,并在4个挑战性真实世界双臂任务中保持稳定表现。
原文摘要 · Abstract (English)
Bimanual manipulation is a fundamental robotic skill that requires continuous and precise coordination between two arms. While imitation learning (IL) is the dominant paradigm for acquiring this capability, existing approaches, whether robot-centric or object-centric, often overlook the dynamic geometric relationship among the two arms and the manipulated object. This limitation frequently leads to inter-arm collisions, unstable grasps, and degraded performance in complex tasks. To address this, in this paper we explicitly models the Robot-Object Triadic Interaction (RoTri) representation in bimanual systems, by encoding the relative 6D poses between the two arms and the object to capture their spatial triadic relationship and establish continuous triangular geometric constraints. Building on this, we further introduce RoTri-Diff, a diffusion-based imitation learning framework that combines RoTri constraints with robot keyposes and object motion in a hierarchical diffusion process. This enables the generation of stable, coordinated trajectories and robust execution across different modes of bimanual manipulation. Extensive experiments show that our approach outperforms state-of-the-art baselines by 10.2% on 11 representative RLBench2 tasks and achieves stable performance on 4 challenging real-world bimanual tasks. Project website: https://rotri-diff.github.io/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。