让触觉传感器透明可见,实现高精度近距触感捕捉。
TransTac: Visuo-Tactile Modality Transition via Ultraviolet-Encoded Transparent Elastomers

- 用紫外反光标记的透明弹性体+自适应匹配算法,融合视觉与触觉信息。
- 零样本识别准确率达83.3%,比传统方法高50个百分点。
- 成本约70美元,适合机器人、人机交互等需透明触觉场景。
基于视觉的触觉传感器(VBTS)可恢复高分辨率接触几何,但通常依赖不透明弹性层,阻碍视觉透明性;而RGB-D相机虽具全局深度感知能力,但在近距离时性能显著下降。为解决此问题,本文提出TransTac——一种集成双目视觉观察与基于标记的触觉重建的透明紫外编码VBTS。该系统采用嵌有紫外反射标记的透明弹性体,并结合先验引导的Delaunay立体匹配算法,实现鲁棒的稀疏三角化。针对密集分布的半透明标记,设计轻量级检测器,确保接触与形变下的稳定定位。所提先验引导的Delaunay匹配相比全局分配基线,对应关系鲁棒性提升约21%,同时保持高重建精度。语义评估中,TransTac在触觉图像上达到最高83.3%的零样本识别准确率,较不透明基线提升约50个百分点。嵌入分析显示其与自然图像的跨模态对齐显著增强,类中心相似度从约0.2升至超过0.77。近距实验量化了RGB-D深度可靠性下降现象,并验证了视觉-触觉融合带来的几何覆盖扩展。最终实现紧凑原型,硬件成本约70美元。
原文摘要 · Abstract (English)
Vision-based tactile sensors (VBTS) recover high-resolution contact geometry but typically rely on opaque elastomer layers that prevent visual transparency, while RGB-D cameras provide global depth perception yet degrade significantly at close range. To address this limitation, we present TransTac, a transparent ultraviolet (UV)-encoded binocular VBTS that integrates visual observation and marker-based tactile reconstruction within a single compact device. The system employs a transparent elastomer embedded with UV-reflective markers and a prior-guided Delaunay stereo matching algorithm for robust sparse triangulation. To reliably detect densely distributed semitransparent markers, we develop a lightweight detector that enables stable localization under contact and deformation. The proposed prior-guided Delaunay matching improves correspondence robustness by approximately 21% compared with global assignment baselines while maintaining high reconstruction accuracy. In semantic evaluation, TransTac achieves up to 83.3% zero-shot recognition accuracy on tactile images, exceeding opaque tactile baselines by approximately 50 percentage points. Embedding analysis further reveals substantially stronger cross-modal alignment with natural images, with class-center similarity increasing from around 0.2 to over 0.77. Controlled near-distance experiments quantify the degradation of RGB-D depth reliability and demonstrate extended geometric coverage enabled by visuo-tactile integration. Finally, a compact prototype is implemented with an approximate hardware cost of $70.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。