用物体相对位姿指导机器人精准插入,仅需7-10次演示即可完成微米级精度操作。
Exploring Pose-Guided Imitation Learning for Robotic Precise Insertion
- 以SE(3)相对位姿为输入,设计扩散策略预测插入轨迹。
- 在0.01mm间隙下成功率超90%,7-10次演示即达高精度。
- 融合RGBD信息补偿位姿误差,适合工业精密装配场景。
模仿学习在机器人操作中前景广阔,但真实世界中的精准插入仍面临接触动力学复杂、间隙微小及示范数据有限等挑战。现有视觉-运动策略多依赖高维RGB或点云观测,存在数据效率低、姿态变化下泛化能力差的问题。本文提出基于位姿引导的模仿学习方法,采用对象在SE(3)空间中的相对位姿作为紧凑、以对象为中心的观测信号。首先,设计一种扩散策略,通过观测源物体相对于目标物体的相对位姿,预测未来相对位姿轨迹作为动作输出。其次,为提升对位姿估计噪声的鲁棒性,引入RGBD线索增强策略:构建目标条件化的RGBD编码器,捕捉当前与目标状态间的差异,并提出位姿引导的残差门控融合模块,使位姿特征主导控制,而当位姿估计不可靠时,RGBD特征自适应补偿。我们在六个真实机器人精准插入任务上进行评估,每个任务仅需7–10次示范,即可在0.01 mm级微小间隙下实现高成功率,性能显著优于现有基线方法,在数据效率和泛化能力方面均有提升。代码将开源于https://github.com/sunhan1997/PoseInsert。
原文摘要 · Abstract (English)
Imitation learning is promising for robotic manipulation, but \emph{precise insertion} in the real world remains difficult due to contact-rich dynamics, tight clearances, and limited demonstrations. Many existing visuomotor policies depend on high-dimensional RGB/point-cloud observations, which can be data-inefficient and generalize poorly under pose variations. In this paper, we study pose-guided imitation learning by using object poses in $\mathrm{SE}(3)$ as compact, object-centric observations for precise insertion tasks. First, we propose a diffusion policy for precise insertion that observes the \emph{relative} $\mathrm{SE}(3)$ pose of the source object with respect to the target object and predicts a future relative pose trajectory as its action. Second, to improve robustness to pose estimation noise, we augment the pose-guided policy with RGBD cues. Specifically, we introduce a goal-conditioned RGBD encoder to capture the discrepancy between current and goal observations. We further propose a pose-guided residual gated fusion module, where pose features provide the primary control signal and RGBD features adaptively compensate when pose estimates are unreliable. We evaluate our methods on six real-robot precise insertion tasks and achieve high performance with only $7$--$10$ demonstrations per task. In our setup, the proposed policies succeed on tasks with clearances down to $0.01$~mm and demonstrate improved data efficiency and generalization over existing baselines. Code will be available at https://github.com/sunhan1997/PoseInsert.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。