arXiv:2506.02824cs.RO2025-06被引 3

用预训练变压器提升触觉成像效率,少样本也能高精度重建。

Efficient Tactile Perception with Soft Electrical Impedance Tomography and Pre-trained Transformer

  • 基于自监督预训练+少量实测数据微调,突破传统方法对海量标注数据依赖。
  • 仿真中仅需2500样本即达43.57%性能提升,比现有方法少99.44%标注量。
  • 适合需要低功耗、高鲁棒性的机器人抓取与压力适应场景。

触觉感知对机器人系统至关重要,支持多种物理交互任务。尽管如此,实现高分辨率、大范围触觉传感仍具挑战。电气阻抗断层扫描(EIT)因其电极需求少,成为大范围分布式触觉传感的有前途方案,适用于复杂接触问题。然而,现有基于EIT的触觉重建方法常面临计算成本高或依赖大量标注仿真数据的问题,限制了其在真实场景的应用。为此,本文提出一种基于预训练变压器的EIT触觉重建框架(PTET),通过在仿真数据上进行自监督预训练,并结合少量真实数据微调,有效弥合仿真到现实的差距。在仿真中,PTET仅需2500个标注样本,相比先进方法减少99.44%(45万对比2500),同时性能提升最高达43.57%。利用真实数据微调后,模型进一步克服了仿真与实验数据间的差异,在实际场景中实现更优的重建精度与细节恢复。该方法在准确性、数据效率和真实环境鲁棒性方面表现突出,为机器人触觉系统提供了一种可扩展且实用的解决方案,尤其适用于物体抓取与不同压力条件下的自适应抓握任务。

原文摘要 · Abstract (English)

Tactile sensing is fundamental to robotic systems, enabling interactions through physical contact in multiple tasks. Despite its importance, achieving high-resolution, large-area tactile sensing remains challenging. Electrical Impedance Tomography (EIT) has emerged as a promising approach for large-area, distributed tactile sensing with minimal electrode requirements which can lend itself to addressing complex contact problems in robotics. However, existing EIT-based tactile reconstruction methods often suffer from high computational costs or depend on extensive annotated simulation datasets, hindering its viability in real-world settings. To address this shortcoming, here we propose a Pre-trained Transformer for EIT-based Tactile Reconstruction (PTET), a learning-based framework that bridges the simulation-to-reality gap by leveraging self-supervised pretraining on simulation data and fine-tuning with limited real-world data. In simulations, PTET requires 99.44 percent fewer annotated samples than equivalent state-of-the-art approaches (2,500 vs. 450,000 samples) while achieving reconstruction performance improvements of up to 43.57 percent under identical data conditions. Fine-tuning with real-world data further enables PTET to overcome discrepancies between simulated and experimental datasets, achieving superior reconstruction and detail recovery in practical scenarios. The improved reconstruction accuracy, data efficiency, and robustness in real-world tasks establish it as a scalable and practical solution for tactile sensing systems in robotics, especially for object handling and adaptive grasping under varying pressure conditions.

触觉感知TransformerEIT机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。