arXiv:2510.14647cs.RO2025-10被引 10

让机器人用手感信号精准感知物体形状,实现亚毫米级抓取。

Spatially anchored Tactile Awareness for Robust Dexterous Manipulation

  • 将触觉信号锚定在手部运动框架中,实现几何推理
  • 在无模型情况下完成亚毫米级对准,成功率提升30%
  • 适合高精度灵巧操作任务,如插USB-C和拧灯泡

灵巧操作需要精确的几何推理,但现有视觉-触觉学习方法难以应对亚毫米级精度任务,这类任务对传统建模方法而言是常规操作。我们发现关键瓶颈在于:尽管触觉传感器提供丰富接触信息,当前学习框架未能有效结合触觉信号的感知丰富性与其与手部运动学的空间关系。我们认为理想的触觉表征应将接触测量显式锚定在稳定参考系中,同时保留详细感官信息,使策略不仅能检测接触发生,还能在手坐标系中精确推断物体几何。为此提出SaTA(Spatially-anchored Tactile Awareness),一种端到端策略框架,通过正向运动学将触觉特征显式锚定至手部运动学框架,无需物体模型或显式位姿估计即可实现准确几何推理。我们在多个挑战性任务上验证了SaTA的表现,包括自由空间双臂对接USB-C(需亚毫米级对齐精度)、要求精确螺纹啮合与旋转控制的灯泡安装,以及需精细力调节与角度精度的卡片滑动任务。这些任务因精度要求极高,对基于学习的方法构成重大挑战。在多个基准测试中,SaTA显著优于强基线方法,成功率最高提升30个百分点,任务完成时间减少27个百分点。

原文摘要 · Abstract (English)

Dexterous manipulation requires precise geometric reasoning, yet existing visuo-tactile learning methods struggle with sub-millimeter precision tasks that are routine for traditional model-based approaches. We identify a key limitation: while tactile sensors provide rich contact information, current learning frameworks fail to effectively leverage both the perceptual richness of tactile signals and their spatial relationship with hand kinematics. We believe an ideal tactile representation should explicitly ground contact measurements in a stable reference frame while preserving detailed sensory information, enabling policies to not only detect contact occurrence but also precisely infer object geometry in the hand's coordinate system. We introduce SaTA (Spatially-anchored Tactile Awareness for dexterous manipulation), an end-to-end policy framework that explicitly anchors tactile features to the hand's kinematic frame through forward kinematics, enabling accurate geometric reasoning without requiring object models or explicit pose estimation. Our key insight is that spatially grounded tactile representations allow policies to not only detect contact occurrence but also precisely infer object geometry in the hand's coordinate system. We validate SaTA on challenging dexterous manipulation tasks, including bimanual USB-C mating in free space, a task demanding sub-millimeter alignment precision, as well as light bulb installation requiring precise thread engagement and rotational control, and card sliding that demands delicate force modulation and angular precision. These tasks represent significant challenges for learning-based methods due to their stringent precision requirements. Across multiple benchmarks, SaTA significantly outperforms strong visuo-tactile baselines, improving success rates by up to 30 percentage while reducing task completion times by 27 percentage.

灵巧操作触觉感知几何推理机器人控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。