arXiv:2512.20591cs.RO2025-12被引 5

让轻触可见:无需形变即可感知接触的指尖传感器

LightTact: A Visual-Tactile Fingertip Sensor for Deformation-Independent Contact Sensing

  • 用光路屏蔽技术让真实接触点显影,非接触区近乎全黑
  • 像素级接触分割准确,对材质、光照、力度不敏感
  • 可让机器人感知水渍扩散等极轻微接触,适配视觉-语言模型

接触常发生在无宏观形变的场景中,如与液体、半固体或超软材料交互。然而,多数触觉传感器依赖形变来判断接触,难以可靠感知此类轻触。为此,我们提出 LightTact,一种视觉-触觉指尖传感器,通过非形变原理使接触直接可视。LightTact 采用环境光屏蔽的光学结构,抑制非接触区域的外部光与内部照明,仅透射真实接触点产生的散射光。结果生成高对比度原始图像:非接触像素灰度值均<3(近黑),接触像素保留表面自然外观。基于此,LightTact 实现鲁棒的像素级接触分割,不受材料属性、接触力、表面外观和环境光照影响。我们进一步展示其可实现水体铺展、面霜蘸取、软薄膜交互等新型机器人操作。此外,其空间对齐的视觉-触觉图像可被视觉-语言模型直接理解。

原文摘要 · Abstract (English)

Contact often occurs without macroscopic surface deformation, such as during interaction with liquids, semi-liquids, or ultra-soft materials. However, most existing tactile sensors rely on deformation to infer contact, making such light-contact interactions difficult to perceive robustly. To address this, we present LightTact, a visual-tactile fingertip sensor that makes contact directly visible via a deformation-independent principle. LightTact features an ambient-blocking optical configuration that suppresses both external light and internal illumination at non-contact regions, while transmitting only the scattered light generated at true contacts. As a result, LightTact produces high-contrast raw images in which non-contact pixels remain near-black (mean gray value < 3) and contact pixels preserve the natural appearance of the contacting surface. Built on this, LightTact achieves accurate pixel-level contact segmentation that is robust to material properties, contact force, surface appearance, and environmental lighting. We further demonstrate that LightTact unlocks new robotic manipulation behaviors that require detection of extremely light contact, including water spreading, facial-cream dipping, and soft thin-film interaction. In addition, we show that LightTact's spatially aligned visual-tactile images can be directly interpreted by vision-language models.

触觉传感机器人操作视觉融合轻触感知

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。