arXiv:2606.28899cs.RO2026-06

仅靠一次触觉接触,就能精准估计物体6自由度姿态

You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact

论文配图:You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact
图 1 · 摘自论文原文
  • 用触觉点云+分层网络定位接触点位置
  • 双接触点结合传感器位姿,一步求解完整姿态
  • 适合视觉失效场景,可适配手机扫描重建模型

精确的6-DoF物体姿态估计对机器人操作至关重要,但视觉方法在遮挡、弱光、反光或透明表面下常失效。本文提出YOTO,一种仅依赖触觉的姿势估计系统,通过单次同步双接触即可恢复完整6-DoF姿态,无需接触历史。YOTO将每个触觉接触表示为局部3D点云,并通过粗到精网络将其定位到物体表面;两个定位后的接触点与标定的传感器位姿输入闭式法向感知的SVD求解器,一步获得完整姿态。为减少真实数据需求,定位网络先在物体模型生成的虚拟触觉贴片上预训练,再用少量真实接触微调。实验表明,YOTO可在四类几何差异显著的物体上实现高精度触觉定位与姿态估计,优于视觉与几何基线,尤其在视觉不可靠时表现突出。系统支持由消费级手机扫描重建的物体模型,并量化了其与CAD模型的性能差距。代码、训练模型及真实GelSight数据集将在发表后公开。

原文摘要 · Abstract (English)

Accurate 6-DoF object pose estimation is fundamental to robotic manipulation, yet vision-based methods often fail under occlusion, poor lighting, and reflective or transparent surfaces. We present YOTO, a tactile-only pose estimation system that recovers the full 6-DoF object pose from a single pair of simultaneous contacts, without requiring contact history. YOTO represents each tactile contact as a local 3D point cloud and localizes it on the object surface through a coarse-to-fine network. The two localized contacts, together with the calibrated sensor poses, are then fed to a closed-form normal-aware SVD solver that recovers the full 6-DoF object pose in one step. To reduce real-data requirements, the localization network is pretrained on virtual tactile patches sampled from the object model and fine-tuned with a small number of real contacts. We further show that YOTO can operate on object models reconstructed from consumer-grade mobile scans, and quantify the gap relative to CAD-based models. Experiments on four geometrically diverse objects demonstrate accurate tactile contact localization and pose estimation, outperforming vision-based and geometric baselines, especially when visual perception is unreliable. Code, trained models, and the real GelSight dataset will be released upon publication.

触觉感知6-DoF姿态机器人操作单次接触

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。