用触觉感知实现无需训练的插件插入,精度达亚毫米级。
Touch2Insert: Zero-Shot Peg Insertion by Touching Intersections of Peg and Hole
- 通过高分辨率触觉图像重建截面形状,零样本估计孔与插件相对姿态。
- 仿真中所有连接器定位误差小于0.5毫米,真实机器人平均成功率86.7%。
- 适用于未见过的连接器结构,适合工业装配场景中的鲁棒插入任务。
工业连接器的可靠插入仍是机器人领域的核心挑战,需在不确定性下实现亚毫米级精度,且常缺乏完整视觉信息。基于视觉的方法受遮挡和泛化能力限制,学习型策略往往无法迁移到未知几何结构。为此,本文利用触觉传感——其可在接触点捕捉局部表面几何信息,从而在遮挡或新连接器形状下仍提供可靠数据。提出触觉驱动的通用插件插入框架Touch2Insert:从高分辨率触觉图像重建截面几何,并以零样本方式估计孔相对于插件的相对位姿。通过形状配准对齐,系统仅需一次接触即可完成插入,无需任务特定训练。在三种不同连接器上进行仿真与真实机器人实验,结果表明:仿真中所有连接器的位姿估计误差均低于0.5毫米;真实机器人平均成功率达86.7%,验证了触觉感知在现实机器人连接器插入任务中的鲁棒性与泛化能力。
原文摘要 · Abstract (English)
Reliable insertion of industrial connectors remains a central challenge in robotics, requiring sub-millimeter precision under uncertainty and often without full visual access. Vision-based approaches struggle with occlusion and limited generalization, while learning-based policies frequently fail to transfer to unseen geometries. To address these limitations, we leverage tactile sensing, which captures local surface geometry at the point of contact and thus provides reliable information even under occlusion and across novel connector shapes. Building on this capability, we present \emph{Touch2Insert}, a tactile-based framework for arbitrary peg insertion. Our method reconstructs cross-sectional geometry from high-resolution tactile images and estimates the relative pose of the hole with respect to the peg in a zero-shot manner. By aligning reconstructed shapes through registration, the framework enables insertion from a single contact without task-specific training. To evaluate its performance, we conducted experiments with three diverse connectors in both simulation and real-robot settings. The results indicate that Touch2Insert achieved sub-millimeter pose estimation accuracy for all connectors in simulation, and attained an average success rate of 86.7\% on the real robot, thereby confirming the robustness and generalizability of tactile sensing for real-world robotic connector insertion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。