统一非视觉触觉传感器数据,实现跨传感器低误差迁移。
UniTac-NV: A Unified Tactile Representation For Non-Vision-Based Tactile Sensors
- 设计编码器-解码器架构,构建与传感器无关的隐空间。
- 在两种商用触觉传感器上验证,跨传感器误差低且可直接应用。
- 适合机器人触觉感知、多模态传感器融合研究者使用。
通用触觉感知算法仍缺乏探索,主要受限于传感器模态多样性。尽管近年已有大量针对光学触觉传感器的跨传感器迁移研究,但对非光学触觉传感器的关注极少。为此,本文提出一种编码器-解码器架构,用于统一非视觉触觉传感器的数据。通过传感器特异性编码器,该框架构建了一个与传感器无关的隐空间,支持跨传感器数据迁移且误差较低,并可直接用于下游任务。我们利用该网络统一了两种商用触觉传感器——Xela uSkin uSPa 46 和 Contactile PapillArray 的数据。两者均安装于 UR5e 机械臂上,对圆形、方形和六边形棱柱以及刚性 PLA 和柔性 TPU 两种材料执行力控按压序列,并包含一个更复杂的未见物体以检验模型泛化能力。结果表明,通过联合自编码器训练,可在不同传感器间隐式学习到接触点对齐。进一步实验显示,在接触几何估计任务中,基于某一传感器隐表示训练的下游模型可直接应用于另一传感器,无需重新训练。
原文摘要 · Abstract (English)
Generalizable algorithms for tactile sensing remain underexplored, primarily due to the diversity of sensor modalities. Recently, many methods for cross-sensor transfer between optical (vision-based) tactile sensors have been investigated, yet little work focus on non-optical tactile sensors. To address this gap, we propose an encoder-decoder architecture to unify tactile data across non-vision-based sensors. By leveraging sensor-specific encoders, the framework creates a latent space that is sensor-agnostic, enabling cross-sensor data transfer with low errors and direct use in downstream applications. We leverage this network to unify tactile data from two commercial tactile sensors: the Xela uSkin uSPa 46 and the Contactile PapillArray. Both were mounted on a UR5e robotic arm, performing force-controlled pressing sequences against distinct object shapes (circular, square, and hexagonal prisms) and two materials (rigid PLA and flexible TPU). Another more complex unseen object was also included to investigate the model's generalization capabilities. We show that alignment in latent space can be implicitly learned from joint autoencoder training with matching contacts collected via different sensors. We further demonstrate the practical utility of our approach through contact geometry estimation, where downstream models trained on one sensor's latent representation can be directly applied to another without retraining.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。