TacPrint可穿戴指尖触觉传感器提升人机接触动作复现精度
TacPrint: A Wearable Fingertip Tactile Sensor for Human-to-Robot Contact Reproduction

- 通过硅胶内侧凸点与24个电容触点一一对应,实现局部电容响应
- 真实-仿真-真实管道预测35×26接触深度图,误差仅0.085mm
- 在抓取与擦拭任务中,成功率从0%提升至90%以上,适合人机协作场景
以人为本的数据采集正成为机器人技能学习的重要范式,但如何无缝集成低成本、可扩展的触觉传感系统,以捕捉精细指尖交互且不破坏自然操作,仍是关键挑战。本文提出可穿戴指尖触觉传感器TacPrint,其硅胶内表面的凸点与24个电容触点一对一匹配,实现局部电容响应。通过真实-仿真-真实流程,从24通道电容信号重建35×26接触深度图。与仿真标签对比,模型在接触区域均方根误差为0.223±0.161 mm,加权质心误差1.213±2.379像素,交并比0.829±0.169。使用实测电容输入时,网络预测深度在引导校准接触中心的平均绝对误差为0.085±0.057 mm(40次试验),接触位置平均误差0.250±0.208 mm(37次非截断试验)。在人机动作重放中,触觉引导补偿使抓取和擦拭成功率分别从0%提升至91.67%和90%。闭环抓取中,密集深度反馈在所有测试位置成功率87.5%,边缘接触下85%,优于原始触点反馈的67.5%和45%。
原文摘要 · Abstract (English)
Human-centric data collection is emerging as a significant paradigm for robot skill acquisition, but seamlessly integrating low-cost, scalable tactile sensing systems that capture fine-grained fingertip interactions without compromising natural operation remains a key challenge. This reduces the reliability of human-to-robot transfer in contact-rich tasks. In this work, we present TacPrint, a wearable fingertip tactile sensor, where protrusions on the inner surface of the silicone skin are aligned one-to-one with 24 capacitive taxels to enable localized capacitive responses. A real-to-sim-to-real pipeline estimates a 35 $\times$ 26 contact-depth map from 24-channel capacitive signals. Against simulation-generated labels, the model achieved a contact-region RMSE of 0.223 $\pm$ 0.161 mm, a weighted-centroid error of 1.213 $\pm$ 2.379 pixels, and an IoU of 0.829 $\pm$ 0.169. With measured capacitive inputs, the network-predicted depth evaluated at the guide-calibrated contact center showed a mean absolute error of 0.085 $\pm$ 0.057 mm across all 40 controlled trials, while the mean contact-position error was 0.250 $\pm$ 0.208 mm across the 37 trials whose reference contact regions were not truncated by the sensing boundary. In human-to-robot replay, tactile-guided compensation increased grasping and wiping success rates from 0% to 91.67% and 90%, respectively. In closed-loop grasping, dense-depth feedback achieved success rates of 87.5% over all tested positions and 85% under edge-contact conditions, compared with 67.5% and 45% for raw-taxel feedback.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。