用视觉和接触力生成高保真触觉图像,提升机器人感知精度。
Vision-based Tactile Image Generation via Contact Condition-guided Diffusion Model
- 基于接触条件引导的扩散模型,融合RGB图像与力数据生成触觉图
- 相比传统方法,均方误差降低60.58%,标记位移误差减少38.1%
- 可适配多种传感器,精准还原物体细微纹理特征
基于视觉的触觉传感器通过高分辨率光学测量,能有效感知物体几何形状及接触过程中的力信息,帮助机器人获取高维触觉数据。视觉触觉传感器仿真可通过准确捕捉和分析接触行为与物理特性,实现无需物理传感器即可获取和理解触觉信息。然而,接触动力学与光照建模的复杂性限制了真实传感器响应在仿真中的精确再现,难以满足不同传感器配置需求,影响策略向实际应用迁移的可靠性和有效性。本文提出一种接触条件引导的扩散模型,将物体的RGB图像与接触力数据映射为高保真、细节丰富的视觉触觉传感器图像。评估表明,该方法生成的三通道触觉图像相比基于光照模型和机械模型的现有方法,均方误差降低60.58%,标记位移误差减少38.1%,验证了方法的有效性。该方法成功应用于多种类型的触觉视觉传感器,在复杂负载下能有效生成对应触觉图像。此外,在蒙台梭利触觉板纹理生成任务中,展现出优异的细纹理特征重建能力。
原文摘要 · Abstract (English)
Vision-based tactile sensors, through high-resolution optical measurements, can effectively perceive the geometric shape of objects and the force information during the contact process, thus helping robots acquire higher-dimensional tactile data. Vision-based tactile sensor simulation supports the acquisition and understanding of tactile information without physical sensors by accurately capturing and analyzing contact behavior and physical properties. However, the complexity of contact dynamics and lighting modeling limits the accurate reproduction of real sensor responses in simulations, making it difficult to meet the needs of different sensor setups and affecting the reliability and effectiveness of strategy transfer to practical applications. In this letter, we propose a contact-condition guided diffusion model that maps RGB images of objects and contact force data to high-fidelity, detail-rich vision-based tactile sensor images. Evaluations show that the three-channel tactile images generated by this method achieve a 60.58% reduction in mean squared error and a 38.1% reduction in marker displacement error compared to existing approaches based on lighting model and mechanical model, validating the effectiveness of our approach. The method is successfully applied to various types of tactile vision sensors and can effectively generate corresponding tactile images under complex loads. Additionally, it demonstrates outstanding reconstruction of fine texture features of objects in a Montessori tactile board texture generation task.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。