arXiv:2411.08533cs.ROcs.AI2024-11ICRA被引 4

用形变信息跨传感器转换触觉数据,让旧数据能用新设备。

ACROSS: A Deformation-Based Cross-Modal Representation for Robotic Tactile Perception

  • 基于传感器形变信息构建跨模态映射
  • 成功将低维BioTac信号转为高维DIGIT图像
  • 适合有旧触觉数据但换新传感器的团队

触觉感知对人机交互至关重要,日益成为机器人研究的关键。像BioTac这样的触觉传感器模拟人类指尖,提供详细的交互数据,广泛用于滑移检测和物体识别。然而,该传感器已过时,导致大量宝贵数据集无法使用。重新采集类似数据既耗时又费力。为此,我们提出ACROSS框架,通过利用传感器形变信息,在不同触觉传感器间实现数据转换。我们以将BioTac信号转换为DIGIT传感器数据为例进行演示。该框架首先将输入信号转化为3D形变网格,再将一种传感器的3D形变网格转换为另一种,最后将生成的3D形变网格映射到目标输出空间。我们解决了从低维触觉表示向高维表示转换这一挑战性问题,成功实现了从BioTac到DIGIT触觉图像的迁移。该方法使珍贵历史数据得以延续使用,并促进不同实验组间的数据共享。

原文摘要 · Abstract (English)

Tactile perception is essential for human interaction with the environment and is becoming increasingly crucial in robotics. Tactile sensors like the BioTac mimic human fingertips and provide detailed interaction data. Despite its utility in applications like slip detection and object identification, this sensor is now deprecated, making many valuable datasets obsolete. However, recreating similar datasets with newer sensor technologies is both tedious and time-consuming. Therefore, adapting these existing datasets for use with new setups and modalities is crucial. In response, we introduce ACROSS, a novel framework for translating data between tactile sensors by exploiting sensor deformation information. We demonstrate the approach by translating BioTac signals into the DIGIT sensor. Our framework consists of first converting the input signals into 3D deformation meshes. We then transition from the 3D deformation mesh of one sensor to the mesh of another, and finally convert the generated 3D deformation mesh into the corresponding output space. We demonstrate our approach to the most challenging problem of going from a low-dimensional tactile representation to a high-dimensional one. In particular, we transfer the tactile signals of a BioTac sensor to DIGIT tactile images. Our approach enables the continued use of valuable datasets and data exchange between groups with different setups.

触觉感知跨模态数据迁移

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。