仅靠一次触觉接触,就能精准估计物体6自由度姿态
You Only Touch Once: 6-DoF Object Pose Estimation from Single Tactile Contact

- 用触觉点云+分层网络定位接触点位置
- 双接触点结合传感器位姿,一步求解完整姿态
- 适合视觉失效场景,可适配手机扫描重建模型
精确的6-DoF物体姿态估计对机器人操作至关重要,但视觉方法在遮挡、弱光、反光或透明表面下常失效。本文提出YOTO,一种仅依赖触觉的姿势估计系统,通过单次同步双接触即可恢复完整6-DoF姿态,无需接触历史。YOTO将每个触觉接触表示为局部3D点云,并通过粗到精网络将其定位到物体表面;两个定位后的接触点与标定的传感器位姿输入闭式法向感知的SVD求解器,一步获得完整姿态。为减少真实数据需求,定位网络先在物体模型生成的虚拟触觉贴片上预训练,再用少量真实接触微调。实验表明,YOTO可在四类几何差异显著的物体上实现高精度触觉定位与姿态估计,优于视觉与几何基线,尤其在视觉不可靠时表现突出。系统支持由消费级手机扫描重建的物体模型,并量化了其与CAD模型的性能差距。代码、训练模型及真实GelSight数据集将在发表后公开。
原文摘要 · Abstract (English)
Accurate 6-DoF object pose estimation is fundamental to robotic manipulation, yet vision-based methods often fail under occlusion, poor lighting, and reflective or transparent surfaces. We present YOTO, a tactile-only pose estimation system that recovers the full 6-DoF object pose from a single pair of simultaneous contacts, without requiring contact history. YOTO represents each tactile contact as a local 3D point cloud and localizes it on the object surface through a coarse-to-fine network. The two localized contacts, together with the calibrated sensor poses, are then fed to a closed-form normal-aware SVD solver that recovers the full 6-DoF object pose in one step. To reduce real-data requirements, the localization network is pretrained on virtual tactile patches sampled from the object model and fine-tuned with a small number of real contacts. We further show that YOTO can operate on object models reconstructed from consumer-grade mobile scans, and quantify the gap relative to CAD-based models. Experiments on four geometrically diverse objects demonstrate accurate tactile contact localization and pose estimation, outperforming vision-based and geometric baselines, especially when visual perception is unreliable. Code, trained models, and the real GelSight dataset will be released upon publication.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。