让机器人通过视觉增强触觉传感器,实现远近与纹理的精准感知。
Look-to-Touch: A Vision-Enhanced Proximity and Tactile Sensor for Distance and Geometry Perception in Robotic Manipulation
- 采用可切换视觉/触觉模式的半透明滑窗结构。
- 实现50厘米到-3毫米全范围距离感知与亚毫米级3D纹理重建。
- 适合软体机械手在复杂环境中执行精细操作。
基于摄像头的触觉传感器为机器人提供了高性能的环境感知与灵巧操作能力。然而,要实现全面的环境感知仍需额外传感器配合,导致系统体积庞大,难以适应非结构化环境。本文提出一种视觉增强型双模态相机触觉传感器,可在50厘米至-3毫米范围内实现全范围距离感知,同时保持超高分辨率的纹理感知与重建能力。不同于传统固定不透明凝胶层设计,该传感器采用部分透明的滑动窗口,支持触觉与视觉模式的机械切换。针对每种模式,分别提出动态距离感知模型与接触几何重构模型。结合软体机械手指进行系统性评估,实验结果表明,该传感器在多种速度下均能实现稳定距离追踪、纳米级粗糙度检测及亚毫米级三维纹理重建。两种模态协同工作显著提升了机器人抓取任务效率。此外,传感器内嵌的机械传动结构支持精细的手内调节与精准操控,为软体机械手开辟了新能力。
原文摘要 · Abstract (English)
Camera-based tactile sensors provide robots with a high-performance tactile sensing approach for environment perception and dexterous manipulation. However, achieving comprehensive environmental perception still requires cooperation with additional sensors, which makes the system bulky and limits its adaptability to unstructured environments. In this work, we present a vision-enhanced camera-based dual-modality sensor, which realizes full-scale distance sensing from 50 cm to -3 mm while simultaneously keeping ultra-high-resolution texture sensing and reconstruction capabilities. Unlike conventional designs with fixed opaque gel layers, our sensor features a partially transparent sliding window, enabling mechanical switching between tactile and visual modes. For each sensing mode, a dynamic distance sensing model and a contact geometry reconstruction model are proposed. Through integration with soft robotic fingers, we systematically evaluate the performance of each mode, as well as in their synergistic operation. Experimental results show robust distance tracking across various speeds, nanometer-scale roughness detection, and sub-millimeter 3D texture reconstruction. The combination of both modalities improves the robot's efficiency in executing grasping tasks. Furthermore, the embedded mechanical transmission in the sensor allows for fine-grained intra-hand adjustments and precise manipulation, unlocking new capabilities for soft robotic hands.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。