用对比学习统一不同触觉传感器的特征表示,提升泛化能力。
Contrastive Touch-to-Touch Pretraining
- 通过对比学习将双传感器触觉信号映射到共享嵌入空间
- 在姿态估计与分类任务中显著提升下游性能
- 实现跨传感器模型直接迁移,无需额外训练
当前触觉传感器设计多样,难以开发通用的触觉信号处理方法。本文提出一种统一表征学习方法,捕捉不同触觉传感器间的共享信息。不同于现有侧重重建或特定任务监督的方法,我们采用对比学习,利用同一物体由多个传感器探测的数据集,将GelSlim与Soft Bubble两种传感器的触觉信号融合至共享嵌入空间。实验表明,所学特征可有效支持下游姿态估计与分类任务;同时,基于一种传感器训练的模型可直接用于另一种传感器,无需重新训练。项目详情见https://www.mmintlab.com/research/cttp/。
原文摘要 · Abstract (English)
Today's tactile sensors have a variety of different designs, making it challenging to develop general-purpose methods for processing touch signals. In this paper, we learn a unified representation that captures the shared information between different tactile sensors. Unlike current approaches that focus on reconstruction or task-specific supervision, we leverage contrastive learning to integrate tactile signals from two different sensors into a shared embedding space, using a dataset in which the same objects are probed with multiple sensors. We apply this approach to paired touch signals from GelSlim and Soft Bubble sensors. We show that our learned features provide strong pretraining for downstream pose estimation and classification tasks. We also show that our embedding enables models trained using one touch sensor to be deployed using another without additional training. Project details can be found at https://www.mmintlab.com/research/cttp/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。