arXiv:2602.19850cs.RO2026-02中稿 · 9th IEEE-RAS Inter…

用单点数据训练,实现复杂多点触觉感知的高精度预测

TactiVerse: Generalizing Multi-Point Tactile Sensing in Soft Robotics Using Single-Point Data

  • 将触觉几何估计转为空间热图预测,基于U-Net架构
  • 单点误差仅0.0589 mm,两点分辨误差从1.214 mm降至0.383 mm
  • 仅用单点数据即可泛化到多点触觉,适合大规模软体机器人应用

实时预测高度柔顺软材料的形变仍是软体机器人中的重大挑战。尽管基于视觉的软触觉传感器可追踪内部标记位移,但基于学习的3D接触估计模型严重依赖训练数据集,难以泛化至复杂场景(如多点感应)。为此,我们提出TactiVerse,一种基于U-Net的框架,将接触几何估计建模为空间热图预测任务。即使仅在有限的单点压痕数据上训练,该架构仍实现了高精度单点感知,平均绝对误差(MAE)达0.0589 mm,优于传统回归型CNN基线的0.0612 mm。此外,通过引入多点接触数据增强训练集,传感器的多点感知能力显著提升,两点辨别总体均值MAE由1.214 mm降低至0.383 mm。该方法成功从基础交互中外推复杂接触几何,为多点及大范围形状感知提供可能。最终,它大幅简化了基于标记的软触觉传感器开发流程,为真实世界的触觉感知提供高可扩展解决方案。

原文摘要 · Abstract (English)

Real-time prediction of deformation in highly compliant soft materials remains a significant challenge in soft robotics. While vision-based soft tactile sensors can track internal marker displacements, learning-based models for 3D contact estimation heavily depend on their training datasets, inherently limiting their ability to generalize to complex scenarios such as multi-point sensing. To address this limitation, we introduce TactiVerse, a U-Net-based framework that formulates contact geometry estimation as a spatial heatmap prediction task. Even when trained exclusively on a limited dataset of single-point indentations, our architecture achieves highly accurate single-point sensing, yielding a superior mean absolute error of 0.0589 mm compared to the 0.0612 mm of a conventional regression-based CNN baseline. Furthermore, we demonstrate that augmenting the training dataset with multi-point contact data substantially enhances the sensor's multi-point sensing capabilities, significantly improving the overall mean MAE for two-point discrimination from 1.214 mm to 0.383 mm. By successfully extrapolating complex contact geometries from fundamental interactions, this methodology unlocks advanced multi-point and large-area shape sensing. Ultimately, it significantly streamlines the development of marker-based soft sensors, offering a highly scalable solution for real-world tactile perception.

软体机器人触觉传感多点感知深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。