用拆钉子反推装钉子,提升机器人装配成功率。
Visual-Tactile Peg-in-Hole Assembly Learning from Peg-out-of-Hole Disassembly

- 先学拆钉子,再反转轨迹训练装钉子。
- 实测接触力降低6.4%,未见物体成功率77.1%。
- 适合做精密装配的机器人研究者参考。
钉入孔(PiH)是基础但具挑战性的机器人操作任务。尽管强化学习(RL)在解决此类任务上展现出潜力,但需大量探索。本文提出一种基于视觉-触觉的新型技能学习框架,利用其逆向任务——钉出孔(PooH)来促进PiH学习。相比PiH,PooH只需克服现有摩擦而无需精确对齐,数据采集更高效。为此,我们将PooH与PiH统一建模为具有共享视觉-触觉观测空间的部分可观测马尔可夫决策过程(POMDP)。首先训练视觉-触觉PooH策略;将其轨迹进行时间反转并动作随机化,生成PiH的专家数据。在策略学习中,视觉用于引导钉子接近,触觉补偿对位偏差。跨多种钉孔几何结构的实验表明,该视觉-触觉策略比单模态方法接触力低6.4%;本框架在已见物体上平均成功率达87.5%,未见物体达77.1%,较从零训练的直接RL方法高出18.1%。演示、代码与数据集详见https://sites.google.com/view/pooh2pih。
原文摘要 · Abstract (English)
Peg-in-hole (PiH) assembly is a fundamental yet challenging robotic manipulation task. While reinforcement learning (RL) has shown promise in tackling such tasks, it requires extensive exploration. In this paper, we propose a novel visual-tactile skill learning framework for the PiH task that leverages its inverse task, i.e., peg-out-of-hole (PooH) disassembly, to facilitate PiH learning. Compared to PiH, PooH is inherently easier as it only needs to overcome existing friction without precise alignment, making data collection more efficient. To this end, we formulate both PooH and PiH as Partially Observable Markov Decision Processes (POMDPs) in a unified environment with shared visual-tactile observation space. A visual-tactile PooH policy is first trained; its trajectories, containing kinematic, visual and tactile information, are temporally reversed and action-randomized to provide expert data for PiH. In the policy learning, visual sensing facilitates the peg-hole approach, while tactile measurements compensate for peg-hole misalignment. Experiments across diverse peg-hole geometries show that the visual-tactile policy attains 6.4% lower contact forces than its single-modality counterparts, and that our framework achieves average success rates of 87.5% on seen objects and 77.1% on unseen objects, outperforming direct RL methods that train PiH policies from scratch by 18.1% in success rate. Demos, code, and datasets are available at https://sites.google.com/view/pooh2pih.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。