translucent标记让触觉传感器同时实现精准力与位移感知和表面细节保留
MagicSkin: Balancing Marker and Markerless Modes in Vision-Based Tactile Sensors with a Translucent Skin
- 用半透明彩色标记替代传统不透明白色标记,兼顾力与位移测量和表面特征保留
- 在物体分类、纹理识别、位移追踪和力预测上均优于传统方案,最高提升66%
- 可直接接入GelSight类传感器,无需额外软硬件,适合触觉机器人研究
基于视觉的触觉传感器(VBTS)在标记式与无标记式设计间存在根本矛盾:不透明墨水标记虽能精准测量力和切向位移,却完全遮蔽用于物体与纹理分类的几何特征;而无标记皮肤虽保留表面细节,却难以有效测量切向位移。现有解决方案如紫外光照明或基于学习的虚拟映射引入了硬件复杂性或计算负担。本文提出MagicSkin,一种具有半透明着色标记的新触觉皮肤,可在保持表面细节的同时实现切向位移追踪、力预测与多模态感知的平衡。该皮肤可无缝集成至GelSight系列传感器,无需额外软硬件。实验表明,相较于传统无标记与墨水标记设计,其在物体分类(99.17%)、纹理分类(93.51%)、切向位移追踪(97%点保留率)和力预测(总力误差降低66%)上均取得最优性能。结果证明,半透明皮肤消除了传统标记/无标记模式间的性能权衡,为触觉机器人所需的多模态感知提供了新路径。
原文摘要 · Abstract (English)
Vision-based tactile sensors (VBTS) face a fundamental trade-off in marker and markerless design on the tactile skin: opaque ink markers enable measurement of force and tangential displacement but completely occlude geometric features necessary for object and texture classification, while markerless skin preserves surface details but struggles in measuring tangential displacements effectively. Current practice to solve the above problem via UV lighting or virtual transfer using learning-based models introduces hardware complexity or computing burdens. This paper introduces MagicSkin, a novel tactile skin with translucent, tinted markers balancing the modes of marker and markerless for VBTS. It enables simultaneous tangential displacement tracking, force prediction, and surface detail preservation. This skin is easy to plug into GelSight-family sensors without requiring additional hardware or software tools. We comprehensively evaluate MagicSkin in downstream tasks. The translucent markers impressively enhance rather than degrade sensing performance compared with traditional markerless and inked marker design: it achieves best performance in object classification (99.17\%), texture classification (93.51\%), tangential displacement tracking (97\% point retention) and force prediction (66\% improvement in total force error). These experimental results demonstrate that translucent skin eliminates the traditional performance trade-off in marker or markerless modes, paving the way for multimodal tactile sensing essential in tactile robotics. See videos at this \href{https://zhuochenn.github.io/MagicSkin_project/}{link}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。